Drone network switchover between wireless networks

ABSTRACT

Systems and methods for Unmanned Aerial Vehicle (UAV) network switchover and emergency procedures, implemented by a UAV includes communicating to an Air Traffic Control (ATC) system via a primary wireless network; receiving and storing emergency instructions from the ATC system; detecting communication disruption on the primary wireless network to the ATC system; responsive to the detecting, switching to a backup wireless network to reestablish communication to the ATC system; and, responsive to failing to reestablish communication to the ATC system via the backup wireless network, implementing the emergency instructions.

CROSS-REFERENCE TO RELATED APPLICATION(S)

The present patent/application is continuation-in-part of, and thecontent of each is incorporated by reference herein

Filing Date Ser. No. Title Jun. 23, 2017 15/631,302 ANTI-DRONE FLIGHTPROTECTION SYSTEMS AND METHODS May 2, 2017 15/584,422 3D COVERAGEMAPPING OF WIRELESS NETWORKS WITH UNMANNED AERIAL VEHICLES Mar. 3, 201715/448,968 EMERGENCY SHUTDOWN AND LANDING FOR UNMANNED AERIAL VEHICLESWITH AIR TRAFFIC CONTROL SYSTEMS Oct. 31, 2016 15/338,559 WAYPOINTDIRECTORY IN AIR TRAFFIC CONTROL SYSTEMS FOR UNMANNED AERIAL VEHICLESOct. 13, 2016 15/292,782 MANAGING DYNAMIC OBSTRUCTIONS IN AIR TRAFFICCONTROL SYSTEMS FOR UNMANNED AERIAL VEHICLES Sep. 19, 2016 15/268,831MANAGING DETECTED OBSTRUCTIONS IN AIR TRAFFIC CONTROL SYSTEMS FORUNMANNED AERIAL VEHICLES Sep. 2, 2016 15/255,672 OBSTRUCTION DETECTIONIN AIR TRAFFIC CONTROL SYSTEMS FOR UNMANNED AERIAL VEHICLES Aug. 23,2016 15/244,023 AIR TRAFFIC CONTROL MONITORING SYSTEMS AND METHODS FORUNMANNED AERIAL VEHICLES Jul. 22, 2016 15/217,135 FLYING LANE MANAGEMENTSYSTEMS AND METHODS FOR UNMANNED AERIAL VEHICLES Jun. 27, 201615/193,488 AIR TRAFFIC CONTROL OF UNMANNED AERIAL VEHICLES FOR DELIVERYAPPLICATIONS Jun. 17, 2016 15/185,598 AIR TRAFFIC CONTROL OF UNMANNEDAERIAL VEHICLES CONCURRENTLY USING A PLURALITY OF WIRELESS NETWORKS Jun.10, 2016 15/179,188 AIR TRAFFIC CONTROL OF UNMANNED AERIAL VEHICLES VIAWIRELESS NETWORKS

FIELD OF THE DISCLOSURE

The present disclosure relates generally to drone or Unmanned AerialVehicles (UAVs). More particularly, the present disclosure relates tosystems and methods for drone network switchover between wirelessnetworks such as during outages, failures, catastrophes, etc.

BACKGROUND OF THE DISCLOSURE

Use of Unmanned Aerial Vehicles (UAVs or “drones”) is proliferating.UAVs are used for a variety of applications such as search and rescue,inspections, security, surveillance, scientific research, aerialphotography and video, surveying, cargo delivery, and the like. With theproliferation, the Federal Aviation Administration (FAA) is providingregulations associated with the use of UAVs. Existing air trafficcontrol in the United States is performed through a dedicated airtraffic control network, i.e., the National Airspace System (NAS).However, it is impractical to use the existing air traffic controlnetwork for UAVs because of the sheer quantity of UAVs. Also, it isexpected that UAVs will be autonomous, requiring communication forflight control as well. There will be a need for systems and methods toprovide air traffic control and communication to UAVs.

There is a great deal of discussion and anticipation for using dronesfor applications such as package delivery. For example, online stores,brick & mortar stores, restaurants, etc. can use drones to providedelivery to end consumers. As the number of applications increases andthe number of UAVs concurrently in flight also increases, there arevarious issues that have to be addressed relative to air trafficcontrol.

As UAV use proliferates, there is a need to coordinate flying lanes toavoid collisions, obstructions, etc. Of course, with UAV use as a hobby,collision avoidance is not a major concern. However, once UAVs beginwidespread delivery applications, collisions will be a major problem dueto the potential damage to deliveries as well as threats to people andproperty on the ground. Thus, there is a need for flying lane managementsystems and methods.

Further, it is expected that there will be orders of magnitude more UAVsin flight in any geographic region, zone, coverage area, etc. thanregular aircraft. Accordingly, conventional monitoring systems andmethods are inadequate to support UAV monitoring. Thus, there is a needfor optimized UAV monitoring systems and methods.

Further, obstructions on or near the ground pose a significant risk toUAVs as most UAVs fly only several hundred feet above the ground, unlikeairplanes which fly at thousands of feet above the ground. Stateddifferently, air traffic control for airplanes focuses on otherairplanes primarily whereas air traffic control for UAVs must deal withother UAVs and with near ground obstructions.

Additionally, obstructions on or near the ground are different fromin-air obstructions (other aircraft) and require additional management.That is, it is not enough to simply note a single location (e.g., GlobalPositioning Satellite (GPS) coordinate) since these obstructions may beof varying sizes, heights, etc.

Further, with the expected growth of UAVs, there will be situationswhere UAVs are in distress, failure, unauthorized, in no-fly zones, etc.and there exists a need for techniques to shut down and/or causeimmediate landing of these UAVs. Importantly, an uncontrolled shutdownand/or landing could be hazardous to physical structures, vehicles,people, etc. on the ground. Thus, there exists a need to coordinateshutdowns and/or landings of UAVs when needed.

Further, conventional wireless networks (e.g., Long Term Evolution(LTE), 5G, etc.) are optimized with the assumption User Equipment (UE)is located on the ground or close to it (e.g., multi-story buildings).There has not been a need to have adequate wireless coverage above theground, e.g., several hundred feet to several thousand feet. With theproliferation of UAVs and the desire to have Air Traffic Control (ATC)using existing wireless networks (e.g., LTE, 5G, etc.), it is importantto ensure adequate coverage, to identify coverage gaps, etc.

In addition to the aforementioned issues with UAV or droneproliferation, there is a need to keep UAVs from enteringtelecommunication compounds/cell sites, data centers, historicalmonuments/locations, privacy centers, and other no fly zones whichcompanies/persons want to deem a no-fly zone.

BRIEF SUMMARY OF THE DISCLOSURE

In an exemplary embodiment, a method for Unmanned Aerial Vehicle (UAV)network switchover and emergency procedures, implemented by a UAVincludes communicating to an Air Traffic Control (ATC) system via aprimary wireless network; receiving and storing emergency instructionsfrom the ATC system; detecting communication disruption on the primarywireless network to the ATC system; responsive to the detecting,switching to a backup wireless network to reestablish communication tothe ATC system; and, responsive to failing to reestablish communicationto the ATC system via the backup wireless network, implementing theemergency instructions.

In another exemplary embodiment, an Unmanned Aerial Vehicle (UAV)configured for network switchover to communicate with an Air TrafficControl (ATC) system includes one or more rotors disposed to a body andconfigured for flight; wireless interfaces including hardware andantennas adapted to communicate with a primary wireless network and abackup wireless network of a plurality of wireless networks; a processorcoupled to the wireless interfaces and the one or more rotors; andmemory storing instructions that, when executed, cause the processor to:communicate to ATC system via the primary wireless network; receive andstore emergency instructions from the ATC system; detect communicationdisruption on the primary wireless network to the ATC system; responsiveto detection of the communication disruption, switch to the backupwireless network to reestablish communication to the ATC system; and,responsive to failure to reestablish communication to the ATC system viathe backup wireless network, implement the emergency instructions.

In an exemplary embodiment, a method for preventing flight of one ormore Unmanned Aerial Vehicles (UAVs) in no-fly zones includes receivingone or more no-fly zones each defined as geofences with associatedcoordinates; preventing one or more UAVs from entering the one or moreno-fly zones by one or more of: transmitting the geofences to the one ormore UAVs, transmitting avoidance commands to the one or more UAVs froman avoidance device located at a no-fly zone, and disrupting radiocommunication to the one or more UAVs from the avoidance device.

In another exemplary embodiment, an avoidance device for preventingflight of one or more Unmanned Aerial Vehicles (UAVs) in no-fly zonesincludes wireless interfaces; a processor communicatively coupled to thewireless interfaces; and memory storing instructions that, whenexecuted, cause the processor to receive one or more no-fly zones eachdefined as geofences with associated coordinates; prevent one or moreUAVs from entering the one or more no-fly zones by one or more of:transmission of the geofences to the one or more UAVs, transmission ofavoidance commands to the one or more UAVs located at a no-fly zone, anddisruption of radio communication to the one or more UAVs.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure is illustrated and described herein withreference to the various drawings, in which like reference numbers areused to denote like system components/method steps, as appropriate, andin which:

FIG. 1 is a diagram of a side view of an exemplary cell site;

FIG. 2 is a perspective view of an exemplary UAV for use with thesystems and methods described herein;

FIG. 3 is a block diagram of a mobile device, which may be embedded orassociated with the UAV of FIG. 1;

FIG. 4 is a network diagram of various cell sites deployed in ageographic region;

FIG. 5 is a block diagram of functional components of a UAV air trafficcontrol system;

FIG. 6 is a diagram of various cell sites deployed in a geographicregion;

FIG. 7 is a map of three cell towers and associated coverage areas fordescribing location determination of the UAV;

FIG. 8 is a flowchart of a UAV air traffic control method utilizingwireless networks;

FIG. 9 is a flowchart of a UAV air traffic control method concurrentlyutilizing a plurality of wireless networks;

FIG. 10 is a flowchart of a packet delivery authorization and managementmethod utilizing the UAV air traffic control system of FIG. 5;

FIG. 11 is a diagram of a flight path of an associated flying lane of aUAV from takeoff to landing;

FIG. 12 is a diagram of obstruction detection by the UAV and associatedchanges to the flying lane;

FIG. 13 is a flowchart of a flying lane management method via an airtraffic control system communicatively coupled to a UAV via one or morewireless networks;

FIG. 14 is a block diagram of functional components of a consolidatedUAV air traffic control monitoring system;

FIG. 15 is a screen shot of a Graphical User Interface (GUI) providing aview of the consolidated UAV air traffic control monitoring system;

FIG. 16 is a flowchart of a UAV air traffic control and monitor method;

FIGS. 17 and 18 are block diagrams of the UAV air traffic control systemdescribing functionality associated with obstruction detection,identification, and management with FIG. 17 describing data transferfrom the UAVs to the servers and FIG. 18 describing data transfer to theUAVs from the servers;

FIG. 19 is a flowchart of an obstruction detection and management methodimplemented through the UAV air traffic control system for the UAVs;

FIG. 20 is a diagram of geographical terrain with exemplary staticobstructions;

FIG. 21 is diagrams of data structures which can be used to define theexact location of any of the static obstructions;

FIG. 22 is a flowchart of a static obstruction detection and managementmethod through an Air Traffic Control (ATC) system for Unmanned AerialVehicles (UAVs);

FIG. 23 is a block diagram of functional components implemented inphysical components in the UAV for use with the air traffic controlsystem, such as for dynamic and static obstruction detection;

FIG. 24 is a flowchart of a UAV method for obstruction detection;

FIG. 25 is a flowchart of a waypoint management method for an AirTraffic Control (ATC) system for Unmanned Aerial Vehicles (UAVs);

FIG. 26 is a flowchart of an air traffic control method for addressingrogue or distressed UAVs;

FIG. 27 is a flowchart of a 3D wireless coverage mapping method usingthe UAV;

FIG. 28 is a flowchart of an anti-UAV flight protection method;

FIG. 29 is a block diagram of an avoidance device placed in a locationto enforce a no-fly zone or geofence of UAVs;

FIG. 30 is a flowchart of a UAV network switchover and emergencyprocedure method.

DETAILED DESCRIPTION OF THE DISCLOSURE

In various exemplary embodiments, the present disclosure relates tosystems and methods for drone network switchover between wirelessnetworks such as during outages, failures, catastrophes, etc. Asdescribed herein, an Air Traffic Control (ATC) system can be used tocontrol UAVs or drones with communication via existing wirelessnetworks. The UAVs can be configured to communicate on multipledifferent wireless networks, such as a primary and a backup network. Thesystems and methods herein provide techniques for the switchover fromone network to another under certain circumstances. Additionally,emergency instructions can be provided to the UAVs in case of networkdisturbances, e.g., in the event the UAV cannot reestablishcommunication with the ATC system.

Further, in various exemplary embodiments, the present disclosurerelates to systems and methods for anti-drone flight protection to keepdrones or UAVs from certain locations. Various embodiments include useof an Air Traffic Control (ATC) system with programming, an apparatuswhich enforces a no-fly zone or geofence, a database regularly updatedwith coordinates of no-fly zones or geofences, and the like. Theseembodiments ensure drones or UAVs (referred to herein as UAVs) do notenter specific locations, such as telecommunication compounds/cellsites, data centers, historical monuments/locations, privacy centers,and the like.

Further, in various exemplary embodiments, the present disclosurerelates to systems and methods for three-dimensional (3D) coveragemapping of wireless networks using Unmanned Aerial Vehicles (UAVs or“drones”). A UAV is equipped with a spectrum measurement device, e.g., aspectrum analyzer, and the UAV flies about a cell site's coverage areataking measurements. The associated measurements are used to develop a3D coverage map of the coverage area. The 3D coverage map can be used toidentify coverage gaps above the ground in the coverage area. With knowncoverage gaps, an operator can add antennas, adjust antennas, etc. toclose the gaps. Also, an Air Traffic Control (ATC) system using awireless network associated with the cell site can adjust UAV flightaccordingly, i.e., to avoid such coverage gaps. Further, the UAV-basedcoverage map is more efficient and cost effective than conventionalapproaches which utilize on-the-ground measurements.

Further, in various exemplary embodiments, the present disclosurerelates to systems and methods for emergency shutdown and landing forUAVs using air traffic control systems. Specifically, the systems andmethods for emergency shutdown and landing utilize the air trafficcontrol system and/or the UAV to 1) determine an emergency shutdownand/or landing, 2) timing and location for the emergency shutdown and/orlanding, and 3) implementation of the emergency shutdown and/or landing.Advantageously, the air traffic control system has a unified view ofUAVs in a given geography and can intelligently determine the timing andlocation based on the geography to minimize the risk of harm to physicalproperty, vehicles on the road, people on the ground, etc. UAVs can beprogrammed with so-called “kill codes” for implementation of theemergency shutdown and/or landing with the air traffic control systems.Alternatively, the UAVs can perform the emergency shutdown and/or landwithout communication to the air traffic control system. In allembodiments, the objective of the emergency shutdown and/or landing isto minimize risk and damage, i.e., the ideal scenario for a distressedor rogue UAV is to safely shutdown and land in an empty field.

Further, in various exemplary embodiments, the present disclosurerelates to systems and methods for with a waypoint directory in airtraffic control systems for UAVs. A waypoint is a reference point inphysical space used for purposes of navigation in the air trafficcontrol systems for UAVs. Variously, the systems and methods describemanaging waypoints by an air traffic control system which uses one ormore wireless networks and by associated UAVs in communication with theair traffic control system. The waypoints can be defined based on thegeography, e.g., different sizes for dense urban areas, suburban metroareas, and rural areas. The air traffic control system can maintain astatus of each waypoint, e.g., clear, obstructed, or unknown. The statuscan be continually updated and managed with the UAVs and used forrouting the UAVs.

In another exemplary embodiment, the present disclosure relates tosystems and methods for managing detected obstructions with air trafficcontrol systems for UAVs. Variously, the systems and methods provide amechanism in the Air Traffic Control (ATC) System to characterizedetected obstructions at or near the ground. In an exemplary embodiment,the detected obstructions are dynamic obstructions, i.e., moving at ornear the ground. Examples of dynamic obstructions can include, withoutlimitation, other UAVs, vehicles on the ground, cranes on the ground,and the like. Generally, dynamic obstruction management includesmanaging other UAVs at or near the ground and managing objects on theground which are moving and could either interfere with landing or withlow-flying UAVs. In various exemplary embodiments, the UAVs are equippedto locally detect and identify dynamic obstructions for avoidancethereof and to notify the ATC system for management thereof.

In another exemplary embodiment, the detected obstructions are staticobstructions, i.e., not moving, which can be temporary or permanent. TheATC system can implement a mechanism to accurately define the locationof the detected obstructions, for example, a virtual rectangle,cylinder, etc. defined by location coordinates and altitude. The definedlocation can be managed and determined between the ATC system and theUAVs as well as communicated to the UAVs for flight avoidance. That is,the defined location can be a “no-fly” zone for the UAVs. Importantly,the defined location can be precise since it is expected there are asignificant number of obstructions at or near the ground and the UAVsneed to coordinate their flight to avoid these obstructions. In thismanner, the systems and methods seek to minimize the no-fly zones.

Further, in various exemplary embodiments, the present disclosurerelates to obstruction detection systems and methods with air trafficcontrol systems for UAVs. Specifically, the systems and methods use aframework of an air traffic control system which uses wireless (cell)networks to communicate with various UAVs. Through such communication,the air traffic control system receives continuous updates related toexisting obstructions whether temporary or permanent, maintains adatabase of present obstructions, and updates the various UAVs withassociated obstructions in their flight plan. The systems and methodscan further direct UAVs to investigate, capture data, and provide suchdata for analysis to detect and identify obstructions for addition inthe database. The systems and methods can make use of the vast datacollection equipment on UAVs, such as cameras, radar, etc. to properlyidentify and classify obstructions.

Further, in various exemplary embodiments, the present disclosurerelates to air traffic control monitoring systems and methods for UAVs.Conventional FAA Air Traffic Control monitoring approaches are able totrack and monitor all airplanes flying in the U.S. concurrently. Suchapproaches do not scale with UAVs which can exceed airplanes in numbersby several orders of magnitude. The systems and methods provide ahierarchical monitoring approach where zones or geographic regions ofcoverage are aggregated into a consolidated view for monitoring andcontrol. The zones or geographic regions can provide local monitoringand control while the consolidated view can provide national monitoringand control in addition to local monitoring and control through adrill-down process. A consolidated server can aggregate data fromvarious sources of control for zones or geographic regions. From thisconsolidated server, monitoring and control can be performed for any UAVcommunicatively coupled to a wireless network.

Further, in various exemplary embodiments, flying lane managementsystems and methods are described for UAVs such as through an airtraffic control system that uses one or more wireless networks. Asdescribed herein, a flying lane for a UAV represents its path fromtakeoff to landing at a certain time. The objective of flying lanemanagement is to prevent collisions, congestion, etc. with UAVs inflight. A flying lane can be modeled as a vector which includescoordinates and altitude (i.e., x, y, and z coordinates) at a specifiedtime. The flying lane also can include speed and heading such that thefuture location can be determined. The flying lane management systemsutilize one or more wireless networks to manage UAVs in variousapplications.

Note, flying lanes for UAVs have significant differences fromconventional air traffic control flying lanes for aircraft (i.e.,commercial airliners). First, there will be orders of magnitude moreUAVs in flight than aircraft. This creates a management and scale issue.Second, air traffic control for UAVs is slightly different than aircraftin that collision avoidance is paramount in aircraft; while stillimportant for UAVs, the objective does not have to be collisionavoidance at all costs. It is further noted that this ties into thescale issue where the system for managing UAVs will have to manage somany more UAVs. Collision avoidance in UAVs is about avoiding propertydamage in the air (deliveries and the UAVs) and on the ground; collisionavoidance in commercial aircraft is about safety. Third, UAVs are flyingat different altitudes, much closer to the ground, i.e., there may bemany more ground-based obstructions. Fourth, UAVs do not have designatedtakeoff/landing spots, i.e., airports, causing the different flightphases to be intertwined more, again adding to more managementcomplexity.

To address these differences, the flying lane management systems andmethods provide an autonomous/semi-autonomous management system, usingone or more wireless networks, to control and manage UAVs in flight, inall phases of a flying plane and adaptable based on continuous feedbackand ever changing conditions.

Also, in various exemplary embodiments, the present disclosure relatesto air traffic control of UAVs in delivery applications, i.e., using thedrones to deliver packages, etc. to end users. Specifically, an airtraffic control system utilizes existing wireless networks, such aswireless networks including wireless provider networks, i.e., cellnetworks, using Long Term Evolution (LTE) or the like, to provide airtraffic control of UAVs. Also, the cell networks can be used incombination with other networks such as the NAS network or the like.Advantageously, cell networks provide high-bandwidth connectivity,low-cost connectivity, and broad geographic coverage. The air trafficcontrol of the UAVs can include, for example, separation assurancebetween UAVs; navigation assistance; weather and obstacle reporting;monitoring of speed, altitude, location, direction, etc.; trafficmanagement; landing services; and real-time control. The UAV is equippedwith a mobile device, such as an embedded mobile device or physicalhardware emulating a mobile device. In an exemplary embodiment, the UAVcan be equipped with hardware to support plural cell networks, to allowfor broad coverage support. In another exemplary embodiment, UAV flightplans can be constrained based on the availability of wireless cellcoverage. In a further exemplary embodiment, the air traffic control canuse plural wireless networks for different purposes such as using theNAS network for location and traffic management and using the cellnetwork for the other functions.

The present disclosure leverages the existing wireless networks toaddress various issues associated with specific UAV applications such asdelivery and to address the vast number of UAVs concurrently expected inflight relative to air traffic control. In an exemplary embodiment, inaddition to air traffic control, the air traffic control system alsosupports package delivery authorization and management, landingauthorization and management, separation assurance through altitude andflying lane coordination, and the like. Thus, the air traffic controlsystem, leveraging existing wireless networks, can also provideapplication specific support.

§ 1.0 Exemplary Cell Site

Referring to FIG. 1, in an exemplary embodiment, a diagram illustrates aside view of an exemplary cell site 10. The cell site 10 includes a celltower 12. The cell tower 12 can be any type of elevated structure, suchas 100-200 feet/30-60 meters tall. Generally, the cell tower 12 is anelevated structure for holding cell site components 14. The cell tower12 may also include a lightning rod 16 and a warning light 18. Ofcourse, there may be various additional components associated with thecell tower 12 and the cell site 10 which are omitted for illustrationpurposes. In this exemplary embodiment, there are four sets 20, 22, 24,26 of cell site components 14, such as for four different wirelessservice providers. In this example, the sets 20, 22, 24 include variousantennas 30 for cellular service. The sets 20, 22, 24 are deployed insectors, e.g., there can be three sectors for the cell site components—alpha, beta, and gamma. The antennas 30 are used to both transmit aradio signal to a mobile device and receive the signal from the mobiledevice. The antennas 30 are usually deployed as a single, groups of two,three or even four per sector. The higher the frequency of spectrumsupported by the antenna 30, the shorter the antenna 30. For example,the antennas 30 may operate around 850 MHz, 1.9 GHz, and the like. Theset 26 includes a microwave dish 32 which can be used to provide othertypes of wireless connectivity, besides cellular service. There may beother embodiments where the cell tower 12 is omitted and replaced withother types of elevated structures such as roofs, water tanks, etc.

§ 1.1 FAA Regulations

The FAA is overwhelmed with applications from companies interested inflying drones, but the FAA is intent on keeping the skies safe.Currently, approved exemptions for flying drones include tight rules.Once approved, there is some level of certification for drone operatorsalong with specific rules such as speed limit of 100 mph, heightlimitations such as 400 ft, no-fly zones, only day operation,documentation, and restrictions on aerial filming. It is expected thatthese regulations will loosen as UAV deployments evolve. However, it isexpected that the UAV regulations will require flight which wouldaccommodate wireless connectivity to cell towers 12, e.g., less than afew hundred feet.

§ 2.0 Exemplary Hardware

Referring to FIG. 2, in an exemplary embodiment, a perspective viewillustrates an exemplary UAV 50 for use with the systems and methodsdescribed herein. Again, the UAV 50 may be referred to as a drone or thelike. The UAV 50 may be a commercially available UAV platform that hasbeen modified to carry specific electronic components as describedherein to implement the various systems and methods. The UAV 50 includesrotors 80 attached to a body 82. A lower frame 84 is located on a bottomportion of the body 82, for landing the UAV 50 to rest on a flat surfaceand absorb impact during landing. The UAV 50 also includes a camera 86which is used to take still photographs, video, and the like.Specifically, the camera 86 is used to provide the real-time display ona screen. The UAV 50 includes various electronic components inside thebody 82 and/or the camera 86 such as, without limitation, a processor, adata store, memory, a wireless interface, and the like. Also, the UAV 50can include additional hardware, such as robotic arms or the like thatallow the UAV 50 to attach/detach components for the cell sitecomponents 14. Specifically, it is expected that the UAV 50 will getbigger and more advanced, capable of carrying significant loads, and notjust a wireless camera.

These various components are now described with reference to a mobiledevice 100 or a processing device 100. Those of ordinary skill in theart will recognize the UAV 50 can include similar components to themobile device 100. In an exemplary embodiment, the UAV 50 can includeone or more mobile devices 100 embedded therein, such as for differentcellular networks. In another exemplary embodiment, the UAV 50 caninclude hardware which emulates the mobile device 100 including supportfor multiple different cellular networks. For example, the hardware caninclude multiple different antennas and unique identifier configurations(e.g., Subscriber Identification Module (SIM) cards). For example, theUAV 50 can include circuitry to communicate with one or more LTEnetworks with an associated unique identifier, e.g., serial number.

Referring to FIG. 3, in an exemplary embodiment, a block diagramillustrates a mobile device 100 hardware, which may be embedded orassociated with the UAV 50. The mobile device 100 can be a digitaldevice that, in terms of hardware architecture, generally includes aprocessor 102, input/output (I/O) interfaces 104, wireless interfaces106, a data store 108, and memory 110. It should be appreciated by thoseof ordinary skill in the art that FIG. 3 depicts the mobile device 100in an oversimplified manner, and a practical embodiment may includeadditional components and suitably configured processing logic tosupport known or conventional operating features that are not describedin detail herein. The components (102, 104, 106, 108, and 110) arecommunicatively coupled via a local interface 112. The local interface112 can be, for example, but not limited to, one or more buses or otherwired or wireless connections, as is known in the art. The localinterface 112 can have additional elements, which are omitted forsimplicity, such as controllers, buffers (caches), drivers, repeaters,and receivers, among many others, to enable communications. Further, thelocal interface 112 may include address, control, and/or dataconnections to enable appropriate communications among theaforementioned components.

The processor 102 is a hardware device for executing softwareinstructions. The processor 102 can be any custom made or commerciallyavailable processor, a central processing unit (CPU), an auxiliaryprocessor among several processors associated with the mobile device100, a semiconductor-based microprocessor (in the form of a microchip orchip set), or generally any device for executing software instructions.When the mobile device 100 is in operation, the processor 102 isconfigured to execute software stored within the memory 110, tocommunicate data to and from the memory 110, and to generally controloperations of the mobile device 100 pursuant to the softwareinstructions. In an exemplary embodiment, the processor 102 may includea mobile-optimized processor such as optimized for power consumption andmobile applications. The I/O interfaces 104 can be used to receive userinput from and/or for providing system output. User input can beprovided via, for example, a keypad, a touch screen, a scroll ball, ascroll bar, buttons, barcode scanner, and the like. System output can beprovided via a display device such as a liquid crystal display (LCD),touch screen, and the like. The I/O interfaces 104 can also include, forexample, a serial port, a parallel port, a small computer systeminterface (SCSI), an infrared (IR) interface, a radio frequency (RF)interface, a universal serial bus (USB) interface, and the like. The I/Ointerfaces 104 can include a graphical user interface (GUI) that enablesa user to interact with the mobile device 100. Additionally, the I/Ointerfaces 104 may further include an imaging device, i.e., camera,video camera, etc.

The wireless interfaces 106 enable wireless communication to an externalaccess device or network. Any number of suitable wireless datacommunication protocols, techniques, or methodologies can be supportedby the wireless interfaces 106, including, without limitation: RF; IrDA(infrared); Bluetooth; ZigBee (and other variants of the IEEE 802.15protocol); IEEE 802.11 (any variation); IEEE 802.16 (WiMAX or any othervariation); Direct Sequence Spread Spectrum; Frequency Hopping SpreadSpectrum; Long Term Evolution (LTE); cellular/wireless/cordlesstelecommunication protocols (e.g. 3G/4G, etc.); wireless home networkcommunication protocols; paging network protocols; magnetic induction;satellite data communication protocols; wireless hospital or health carefacility network protocols such as those operating in the WMTS bands;GPRS; proprietary wireless data communication protocols such as variantsof Wireless USB; and any other protocols for wireless communication. Thewireless interfaces 106 can be used to communicate with the UAV 50 forcommand and control as well as to relay data. Again, the wirelessinterfaces 106 can be configured to communicate on a specific cellnetwork or on a plurality of cellular networks. The wireless interfaces106 include hardware, wireless antennas, etc. enabling the UAV 50 tocommunicate concurrently with a plurality of wireless networks, such ascellular networks, GPS, GLONASS, WLAN, WiMAX, or the like.

The data store 108 may be used to store data. The data store 108 mayinclude any of volatile memory elements (e.g., random access memory(RAM, such as DRAM, SRAM, SDRAM, and the like)), nonvolatile memoryelements (e.g., ROM, hard drive, tape, CDROM, and the like), andcombinations thereof. Moreover, the data store 108 may incorporateelectronic, magnetic, optical, and/or other types of storage media. Thememory 110 may include any of volatile memory elements (e.g., randomaccess memory (RAM, such as DRAM, SRAM, SDRAM, etc.)), nonvolatilememory elements (e.g., ROM, hard drive, etc.), and combinations thereof.Moreover, the memory 110 may incorporate electronic, magnetic, optical,and/or other types of storage media. Note that the memory 110 may have adistributed architecture, where various components are situated remotelyfrom one another but can be accessed by the processor 102. The softwarein memory 110 can include one or more software programs, each of whichincludes an ordered listing of executable instructions for implementinglogical functions. In the example of FIG. 3, the software in the memory110 includes a suitable operating system (O/S) 114 and programs 116. Theoperating system 114 essentially controls the execution of othercomputer programs and provides scheduling, input-output control, fileand data management, memory management, and communication control andrelated services. The programs 116 may include various applications,add-ons, etc. configured to provide end user functionality with themobile device 100, including performing various aspects of the systemsand methods described herein.

It will be appreciated that some exemplary embodiments described hereinmay include one or more generic or specialized processors (“one or moreprocessors”) such as microprocessors; Central Processing Units (CPUs);Digital Signal Processors (DSPs): customized processors such as NetworkProcessors (NPs) or Network Processing Units (NPUs), Graphics ProcessingUnits (GPUs), or the like; Field Programmable Gate Arrays (FPGAs); andthe like along with unique stored program instructions (including bothsoftware and firmware) for control thereof to implement, in conjunctionwith certain non-processor circuits, some, most, or all of the functionsof the methods and/or systems described herein. Alternatively, some orall functions may be implemented by a state machine that has no storedprogram instructions, or in one or more Application Specific IntegratedCircuits (ASICs), in which each function or some combinations of certainof the functions are implemented as custom logic or circuitry. Ofcourse, a combination of the aforementioned approaches may be used. Forsome of the exemplary embodiments described herein, a correspondingdevice in hardware and optionally with software, firmware, and acombination thereof can be referred to as “circuitry configured oradapted to,” “logic configured or adapted to,” etc. perform a set ofoperations, steps, methods, processes, algorithms, functions,techniques, etc. on digital and/or analog signals as described hereinfor the various exemplary embodiments.

Moreover, some exemplary embodiments may include a non-transitorycomputer-readable storage medium having computer readable code storedthereon for programming a computer, server, appliance, device,processor, circuit, etc. each of which may include a processor toperform functions as described and claimed herein. Examples of suchcomputer-readable storage mediums include, but are not limited to, ahard disk, an optical storage device, a magnetic storage device, a ROM(Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM(Erasable Programmable Read Only Memory), an EEPROM (ElectricallyErasable Programmable Read Only Memory), Flash memory, and the like.When stored in the non-transitory computer readable medium, software caninclude instructions executable by a processor or device (e.g., any typeof programmable circuitry or logic) that, in response to such execution,cause a processor or the device to perform a set of operations, steps,methods, processes, algorithms, functions, techniques, etc. as describedherein for the various exemplary embodiments.

§ 3.0 Exemplary Server

Referring to FIG. 4, in an exemplary embodiment, a block diagramillustrates a server 200 which may be used for air traffic control ofthe UAVs 50. The server 200 may be a digital computer that, in terms ofhardware architecture, generally includes a processor 202, input/output(I/O) interfaces 204, a network interface 206, a data store 208, andmemory 210. It should be appreciated by those of ordinary skill in theart that FIG. 4 depicts the server 200 in an oversimplified manner, anda practical embodiment may include additional components and suitablyconfigured processing logic to support known or conventional operatingfeatures that are not described in detail herein. The components (202,204, 206, 208, and 210) are communicatively coupled via a localinterface 212. The local interface 212 may be, for example, but notlimited to, one or more buses or other wired or wireless connections, asis known in the art. The local interface 212 may have additionalelements, which are omitted for simplicity, such as controllers, buffers(caches), drivers, repeaters, and receivers, among many others, toenable communications. Further, the local interface 212 may includeaddress, control, and/or data connections to enable appropriatecommunications among the aforementioned components.

The processor 202 is a hardware device for executing softwareinstructions. The processor 202 may be any custom made or commerciallyavailable processor, a central processing unit (CPU), an auxiliaryprocessor among several processors associated with the server 200, asemiconductor-based microprocessor (in the form of a microchip or chipset), or generally any device for executing software instructions. Whenthe server 200 is in operation, the processor 202 is configured toexecute software stored within the memory 210, to communicate data toand from the memory 210, and to generally control operations of theserver 200 pursuant to the software instructions. The I/O interfaces 204may be used to receive user input from and/or for providing systemoutput to one or more devices or components. User input may be providedvia, for example, a keyboard, touchpad, and/or a mouse. System outputmay be provided via a display device and a printer (not shown). I/Ointerfaces 204 may include, for example, a serial port, a parallel port,a small computer system interface (SCSI), a serial ATA (SATA), a fibrechannel, Infiniband, iSCSI, a PCI Express interface (PCI-x), an infrared(IR) interface, a radio frequency (RF) interface, and/or a universalserial bus (USB) interface.

The network interface 306 may be used to enable the server 200 tocommunicate over a network, such as to a plurality of UAVs 50 over acell network or the like. The network interface 206 may include, forexample, an Ethernet card or adapter (e.g., 10BaseT, Fast Ethernet,Gigabit Ethernet, 10 GbE) or a wireless local area network (WLAN) cardor adapter (e.g., 802.11a/b/g/n). The network interface 206 may includeaddress, control, and/or data connections to enable appropriatecommunications on the network. A data store 208 may be used to storedata. The data store 208 may include any of volatile memory elements(e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, and thelike)), nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM,and the like), and combinations thereof. Moreover, the data store 208may incorporate electronic, magnetic, optical, and/or other types ofstorage media. In one example, the data store 208 may be locatedinternal to the server 200 such as, for example, an internal hard driveconnected to the local interface 212 in the server 200. Additionally, inanother embodiment, the data store 208 may be located external to theserver 200 such as, for example, an external hard drive connected to theI/O interfaces 204 (e.g., SCSI or USB connection). In a furtherembodiment, the data store 208 may be connected to the server 200through a network, such as, for example, a network attached file server.

The memory 210 may include any of volatile memory elements (e.g., randomaccess memory (RAM, such as DRAM, SRAM, SDRAM, etc.)), nonvolatilememory elements (e.g., ROM, hard drive, tape, CDROM, etc.), andcombinations thereof. Moreover, the memory 210 may incorporateelectronic, magnetic, optical, and/or other types of storage media. Notethat the memory 210 may have a distributed architecture, where variouscomponents are situated remotely from one another but can be accessed bythe processor 202. The software in memory 210 may include one or moresoftware programs, each of which includes an ordered listing ofexecutable instructions for implementing logical functions. The softwarein the memory 210 includes a suitable operating system (O/S) 214 and oneor more programs 216. The operating system 214 essentially controls theexecution of other computer programs, such as the one or more programs216, and provides scheduling, input-output control, file and datamanagement, memory management, and communication control and relatedservices. The one or more programs 216 may be configured to implementthe various processes, algorithms, methods, techniques, etc. describedherein.

§ 4.0 UAV Air Traffic Control System

Referring to FIG. 5, in an exemplary embodiment, a block diagramillustrates functional components of a UAV air traffic control system300. The UAV air traffic control system 300 includes a cell network 302and optionally other wireless networks 304 communicatively coupled toone of more servers 200 and to a plurality of UAVs 50. The cell network302 can actually include a plurality of different provider networks,such as AT&T, Verizon, Sprint, etc. The cell network 302 is formed inpart with a plurality of cell towers 12, geographically dispersed andcovering the vast majority of the United States. The cell towers 12 areconfigured to backhaul communications from subscribers. In the UAV airtraffic control system 300, the subscribers are the UAVs 50 (in additionto conventional mobile devices), and the communications are between theUAVs 50 and the servers 200. The other wireless networks 304 caninclude, for example, the NAS network, GPS and/or GLONASS, WLANnetworks, private wireless networks, or any other wireless networks.

The servers 200 are configured to provide air traffic control and can bedeployed in a control center, at a customer premises, in the cloud, orthe like. Generally, the servers 200 are configured to receivecommunications from the UAVs 50 such as for continuous monitoring and ofrelevant details of each UAV 50 such as location, altitude, speed,direction, function, etc. The servers 200 are further configured totransmit communications to the UAVs 50 such as for control based on thedetails, such as to prevent collisions, to enforce policies, to providenavigational control, to actually fly the UAVs 50, to land the UAVs 50,and the like. That is, generally, communications from the UAV 50 to theserver 200 are for detailed monitoring and communications to the UAV 50from the server 200 are for control thereof.

§ 4.1 Data Management

Each UAV 50 is configured with a unique identifier, such as a SIM cardor the like. Similar to standard mobile devices 100, each UAV 50 isconfigured to maintain an association with a plurality of cell towers 12based on a current geographic location. Using triangulation or otherlocation identification techniques (GPS, GLONASS, etc.), the location,altitude, speed, and direction of each UAV 50 can be continuouslymonitored and reported back to the servers 200. The servers 200 canimplement techniques to manage this data in real-time in an automatedfashion to track and control all UAVs 50 in a geographic region. Forexample, the servers 200 can manage and store the data in the data store208.

§ 4.2 Air Traffic Control Functions

The servers 200 are configured to perform air traffic controlfunctionality of the UAV air traffic control system 300. Specifically,the servers 200 are configured to perform separation assurance,navigation, traffic management, landing, and general control of the UAVs50. The separation assurance includes tracking all of the UAVs 50 inflight, based on the monitored data, to ensure adequate separation. Thenavigation includes maintaining defined airways. The traffic managementincludes comparing flight plans of UAVs 50 to avoid conflicts and toensure the smooth and efficient flow of UAVs 50 in flight. The landingincludes assisting and control of UAVs 50 at the end of their flight.The general control includes providing real-time data including videoand other monitored data and allowing control of the UAV 50 in flight.The general control can also include automated flight of the UAVs 50through the UAV air traffic control system 300, such as for autonomousUAVs. Generally, the UAV air traffic control system 300 can includerouting and algorithms for autonomous operation of the UAVs 50 based oninitial flight parameters. The UAV air traffic control system 300 cancontrol speed, flight path, and altitude for a vast number of UAVs 50simultaneously.

§ 5.0 UAV Flight Plans

Referring to FIG. 6, in an exemplary embodiment, a network diagramillustrates various cell sites 10 a-10 e deployed in a geographic region400. In an exemplary embodiment, the UAV 50 is configured to fly aflight plan 402 in the geographic region 400 while maintainingassociations with multiple cell sites 10 a-10 e during the flight plan402. In an exemplary embodiment, the UAV 50 is constrained only to flyin the geographic region 400 where it has cell coverage. This constraintcan be preprogrammed based on predetermining cell coverage.Alternatively, the constraint can be dynamically managed by the UAV 50based on monitoring its cell signal level in the mobile device 100hardware. Here, the UAV 50 will alter its path whenever it loses ordetects signal degradation to ensure it is always active on the cellnetwork 302. During the flight plan 402, the cell sites 10 a-10 e areconfigured to report monitored data to the servers 200 periodically toenable real-time air traffic control. Thus, the communication betweenthe UAVs 50 is bidirectional with the servers 200, through theassociated cell sites 10.

In an exemplary embodiment, the UAV 50 maintains an association with atleast three of the cell sites 10 which perform triangulation todetermine the location of the UAV 50. In addition to the cell sites 10on the cell network 302, the UAV 50 can also communicate to the otherwireless networks 304. In an exemplary embodiment, the UAV 50 canmaintain its GPS and/or GLONASS location and report that over the cellnetwork 302. In another exemplary embodiment, the other wirelessnetworks 304 can include satellite networks or the like.

§ 5.1 Triangulation

Referring to FIG. 7, in an exemplary embodiment, a map illustrates threecell towers 12 and associated coverage areas 410, 412, 414 fordescribing location determination of the UAV 50. Typically, for a cellsite 10, in rural locations, the coverage areas 410, 412, 414 can beabout 5 miles in radius whereas, in urban locations, the coverage areas410, 412, 414 can be about 0.5 to 2 miles in radius. One aspect of theUAV air traffic control system 300 is to maintain a precise location atall time of the UAVs 50. This can be accomplished in a plurality ofways, including a combination. The UAV air traffic control system 300can use triangulation based on the multiple cell towers 12, locationidentifiers from GPS/GLONASS transmitted over the cell network 402 bythe UAVs 50, sensors in the UAV 50 for determining altitude, speed,etc., and the like.

§ 6.0 UAV Air Traffic Control Method Utilizing Wireless Networks

Referring to FIG. 8, in an exemplary embodiment, a flowchart illustratesa UAV air traffic control method 450 utilizing wireless networks. TheUAV air traffic control method 450 includes communicating with aplurality of UAVs via a plurality of cell towers associated with thewireless networks, wherein the plurality of UAVs each include hardwareand antennas adapted to communicate to the plurality of cell towers, andwherein each of the plurality of UAVs include a unique identifier (step452); maintaining data associated with flight of each of the pluralityof UAVs based on the communicating (step 454); and processing themaintained data to perform a plurality of functions associated with airtraffic control of the plurality of UAVs (step 456). The UAV-basedmethod 450 can further include transmitting data based on the processingto one or more of the plurality of UAVs to perform the plurality offunctions (step 458). The plurality of UAVs can be configured toconstrain flight based on coverage of the plurality of cell towers. Theconstrained flight can include one or more of pre-configuring theplurality of UAVs to operate only where the coverage exists, monitoringcell signal strength by the plurality of UAVs and adjusting flight basedtherein, and a combination thereof.

The maintaining data can include the plurality of UAVs and/or theplurality of cell towers providing location, speed, direction, andaltitude. The location can be determined based on a combination oftriangulation by the plurality of cell towers and a determination by theUAV based on a location identification network. The plurality offunction can include one or more of separation assurance between UAVs;navigation assistance; weather and obstacle reporting; monitoring ofspeed, altitude, location, and direction; traffic management; landingservices; and real-time control. One or more of the plurality of UAVscan be configured for autonomous operation through the air trafficcontrol. The plurality of UAVs can be configured with mobile devicehardware configured to operate on a plurality of different cellularnetworks.

§ 7.0 UAV Air Traffic Control Method Concurrently Utilizing a Pluralityof Wireless Networks

Referring to FIG. 9, in an exemplary embodiment, a flowchart illustratesan Unmanned Aerial Vehicle (UAV) air traffic control method 500implemented in the UAV 50 during a flight, for concurrently utilizing aplurality wireless networks for air traffic control. The UAV air trafficcontrol method 500 includes maintaining communication with a firstwireless network and a second wireless network of the plurality ofwireless networks (step 502); communicating first data with the firstwireless network and second data with the second wireless networkthroughout the flight, wherein one or more of the first data and thesecond data is provided to an air traffic control system configured tomaintain status of a plurality of UAVs in flight and perform controlthereof (step 504); and adjusting the flight based on one or more of thefirst data and the second data and control from the air traffic controlsystem (step 506). The first wireless network can provide bi-directionalcommunication between the UAV and the air traffic control system and thesecond wireless network can support unidirectional communication to theUAV for status indications. The first wireless network can include oneor more cellular networks and the second wireless network can include alocation identification network. Both the first wireless network and thesecond wireless network can provide bi-directional communication betweenthe UAV and the air traffic control system for redundancy with one ofthe first wireless network and the second wireless network operating asprimary and another as backup. The first wireless network can providebi-directional communication between the UAV and the air traffic controlsystem and the second wireless network can support unidirectionalcommunication from the UAV for status indications.

The UAV air traffic control method can further include constraining theflight based on coverage of one or more of the first wireless networkand the second wireless network (step 508). The constrained flight caninclude one or more of pre-configuring the UAV to operate only where thecoverage exists, monitoring cell signal strength by the UAV andadjusting flight based therein, and a combination thereof. The firstdata can include location, speed, direction, and altitude for reportingto the air traffic control system. The control from the air trafficcontrol system can include a plurality of functions comprising one ormore of separation assurance between UAVs; navigation assistance;weather and obstacle reporting; monitoring of speed, altitude, location,and direction; traffic management; landing services; and real-timecontrol. The UAV can be configured for autonomous operation through theair traffic control system.

In another exemplary embodiment, an Unmanned Aerial Vehicle (UAV)adapted for air traffic control via an air traffic control system andvia communication to a plurality of wireless networks includes one ormore rotors disposed to a body; wireless interfaces including hardwareand antennas adapted to communicate with a first wireless network and asecond wireless network of the plurality of wireless networks, andwherein the UAV comprises a unique identifier; a processor coupled tothe wireless interfaces and the one or more rotors; and memory storinginstructions that, when executed, cause the processor to: maintaincommunication with the first wireless network and the second wirelessnetwork via the wireless interfaces; communicate first data with thefirst wireless network and second data with the second wireless networkthroughout the flight, wherein one or more of the first data and thesecond data is provided to an air traffic control system configured tomaintain status of a plurality of UAVs in flight and perform controlthereof; and adjust the flight based on one or more of the first dataand the second data and control from the air traffic control system. Thefirst wireless network can provide bi-directional communication betweenthe UAV and the air traffic control system and the second wirelessnetwork can support unidirectional communication to the UAV for statusindications. The first wireless network can include one or more cellularnetworks and the second wireless network can include a locationidentification network. Both the first wireless network and the secondwireless network can provide bi-directional communication between theUAV and the air traffic control system for redundancy with one of thefirst wireless network and the second wireless network operating asprimary and another as backup.

The first wireless network can provide bi-directional communicationbetween the UAV and the air traffic control system and the secondwireless network can support unidirectional communication from the UAVfor status indications. The UAV can be configured to constrain theflight based on coverage of one or more of the first wireless networkand the second wireless network. The constrained flight can include oneor more of pre-configuring the UAV to operate only where the coverageexists, monitoring cell signal strength by the UAV and adjusting flightbased therein, and a combination thereof. The first data can includelocation, speed, direction, and altitude for reporting to the airtraffic control system. The control from the air traffic control systemcan include a plurality of functions comprising one or more ofseparation assurance between UAVs; navigation assistance; weather andobstacle reporting; monitoring of speed, altitude, location, anddirection; traffic management; landing services; and real-time control.The UAV can be configured for autonomous operation through the airtraffic control system.

§ 8.0 Package Delivery Authorization and Management

Referring to FIG. 10, in an exemplary embodiment, a flowchartillustrates a packet delivery authorization and management method 600utilizing the UAV air traffic control system 300. The method 600includes communicating with a plurality of UAVs via a plurality of celltowers associated with the wireless networks, wherein the plurality ofUAVs each comprise hardware and antennas adapted to communicate to theplurality of cell towers (step 602); maintaining data associated withflight of each of the plurality of UAVs based on the communicating (step604); processing the maintained data to perform a plurality of functionsassociated with air traffic control of the plurality of UAVs (step 606);and processing the maintained data to perform a plurality of functionsfor the delivery application authorization and management for each ofthe plurality of UAVs (step 608). The maintained data can includelocation information received and updated periodically from each of theplurality of UAVs, and wherein the location information is correlated tocoordinates and altitude. The location information can be determinedbased on a combination of triangulation by the plurality of cell towersand a determination by the UAV based on a location identificationnetwork. The processing for the delivery application authorization andmanagement can include checking the coordinates and the altitude basedon a flight plan, for each of the plurality of UAVs. The checking thecoordinates and the altitude can further include assuring each of theplurality of UAVs is in a specified flying lane.

The maintained data can include current battery and/or fuel status foreach of the plurality of UAVs, and wherein the processing for thedelivery application authorization and management can include checkingthe current battery and/or fuel status to ensure sufficiency to providea current delivery, for each of the plurality of UAVs. The maintaineddata can include photographs and/or video of a delivery location, andwherein the processing for the delivery application authorization andmanagement can include checking the delivery location is clear forlanding and/or dropping a package, for each of the plurality of UAVs.The maintained data can include photographs and/or video of a deliverylocation, and wherein the processing for the delivery applicationauthorization and management comprises, for each of the plurality ofUAVs, checking the delivery location for a delivery technique includingone of landing, dropping via a tether, dropping to a doorstep, droppingto a mailbox, dropping to a porch, and dropping to a garage. Theplurality of UAVs can be configured to constrain flight based oncoverage of the plurality of cell towers. The constrained flight caninclude one or more of pre-configuring the plurality of UAVs to operateonly where the coverage exists, monitoring cell signal strength by theplurality of UAVs and adjusting flight based therein, and a combinationthereof.

§ 8.1 Package Delivery Authorization and Management via the Air TrafficControl System

In another exemplary embodiment, the air traffic control system 300utilizing wireless networks and concurrently supporting deliveryapplication authorization and management includes the processor and thenetwork interface communicatively coupled to one another; and the memorystoring instructions that, when executed, cause the processor to:communicate, via the network interface, with a plurality of UAVs via aplurality of cell towers associated with the wireless networks, whereinthe plurality of UAVs each include hardware and antennas adapted tocommunicate to the plurality of cell towers; maintain data associatedwith flight of each of the plurality of UAVs based on the communicating;process the maintained data to perform a plurality of functionsassociated with air traffic control of the plurality of UAVs; andprocess the maintained data to perform a plurality of functions for thedelivery application authorization and management for each of theplurality of UAVs.

§ 8.2 Landing Authorization and Management

In another exemplary aspect, the air traffic control system 300 can beconfigured to provide landing authorization and management in additionto the aforementioned air traffic control functions and package deliveryauthorization and management. The landing authorization and managementcan be at the home base of the UAV, at a delivery location, and/or at apickup location. The air traffic control system 300 can control andapprove the landing. For example, the air traffic control system 300 canreceive photographs and/or video from the UAV 50 of the location (homebase, delivery location, pickup location). The air traffic controlsystem 300 can make a determination based on the photographs and/orvideo, as well as other parameters such as wind speed, temperature, etc.to approve the landing.

§ 9.0 Separation Assurance via the Air Traffic Control System

In another exemplary aspect, the air traffic control system 300 can beused to for separation assurance through altitude and flying lanecoordination in addition to the aforementioned air traffic controlfunctions, package delivery authorization and management, landingauthorization and management, etc. As the air traffic control system 300has monitored data from various UAVs 50, the air traffic control system300 can keep track of specific flight plans as well as cause changes inreal time to ensure specific altitude and vector headings, i.e., aflight lane. For example, the air traffic control system 300 can includea specific geography of interest, and there can be adjacent air trafficcontrol systems 300 that communicate to one another and share someoverlap in the geography for handoffs. The air traffic control systems300 can make assumptions on future flight behavior based on the currentdata and then direct UAVs 50 based thereon. The air traffic controlsystem 300 can also communicate with commercial aviation air trafficcontrol systems for limited data exchange to ensure the UAVs 50 do notinterfere with commercial aircraft or fly in no-fly zones.

§ 10.0 Flying Lane Management

Referring to FIG. 11, in an exemplary embodiment, a diagram illustratesa flight path of an associated flying lane 700 of a UAV 50 from takeoffto landing. The flying lane 700 covers all flight phases which includepreflight, takeoff, en route, descent, and landing. Again, the flyinglane 700 includes coordinates (e.g., GPS, etc.), altitude, speed, andheading at a specified time. As described herein, the UAV 50 isconfigured to communicate to the air traffic control system 300, duringall of the flight phases, such as via the networks 302, 304. The airtraffic control system 300 is configured to monitor and manage/controlthe flying lane 700 as described herein. The objective of thismanagement is to avoid collisions, avoid obstructions, avoid flight inrestricted areas or areas with no network 302, 304 coverage, etc.

During preflight, the UAV 50 is configured to communicate with the airtraffic control system 300 for approvals (e.g., flight plan,destination, the flying lane 700, etc.) and notification thereof, forverification (e.g., weather, delivery authorization, etc.), and thelike. The key aspect of the communication during the preflight is forthe air traffic control system 300 to become aware of the flying lane700, to ensure it is open, and to approve the UAV 50 for takeoff. Otheraspects of the preflight can include the air traffic control system 300coordinating the delivery, coordinating with other systems, etc. Basedon the communication from the UAV 50 (as well as an operator, scheduler,etc.), the air traffic control system 300 can perform processing to makesure the flying lane 700 is available and if not, to adjust accordingly.

During takeoff, the UAV 50 is configured to communicate with the airtraffic control system 300 for providing feedback from the UAV 50 to theair traffic control system 300. Here, the air traffic control system 300can store and process the feedback to keep up to date with the currentsituation in airspace under control, for planning other flying lanes700, etc. The feedback can include speed, altitude, heading, etc. aswell as other pertinent data such as location (e.g., GPS, etc.),temperature, humidity, the wind, and any detected obstructions duringtakeoff. The detected obstructions can be managed by the air trafficcontrol system 300 as described herein, i.e., temporary obstructions,permanent obstructions, etc.

Once airborne, the UAV is en route to the destination and the airtraffic control system 300 is configured to communicate with the airtraffic control system 300 for providing feedback from the UAV 50 to theair traffic control system 300. Similar to takeoff, the communicationcan include the same feedback. Also, the communication can include anupdate to the flying lane 700 based on current conditions, changes, etc.A key aspect is the UAV 50 is continually in data communication with theair traffic control system 300 via the networks 302, 304.

As the destination is approached, the air traffic control system 300 canauthorize/instruct the UAV 50 to begin the descent. Alternatively, theair traffic control system 300 can pre-authorize based on reaching a setpoint. Similar to takeoff and en route, the communication in the descentcan include the same feedback. The feedback can also include informationabout the landing spot as well as processing by the air traffic controlsystem 300 to change any aspects of the landing based on the feedback.Note, the landing can include a physical landing or hovering andreleasing cargo.

In various embodiments, the air traffic control system 300 is expectedto operate autonomously or semi-autonomously, i.e., there is not a livehuman operator monitoring each UAV 50 flight. This is an importantdistinction between conventional air traffic control for aircraft andthe air traffic control system 300 for UAVs 50. Specifically, it wouldnot be feasible to manage UAVs 50 with live operators. Accordingly, theair traffic control system 300 is configured to communicate and manageduring all flight phases with a large quantity of UAVs 50 concurrentlyin an automated manner.

In an exemplary embodiment, the objective of the flying lane managementthrough the air traffic control system 300 is to manage deliveriesefficiently while secondarily to ensure collision avoidance. Again, thisaspect is different from conventional air traffic control which focusesfirst and foremost of collision avoidance. This is not to say thatcollision avoidance is minimized, but rather it is less important sincethe UAVs 50 can themselves maintain a buffer from one another based onthe in-flight detection. To achieve the management, the air trafficcontrol system 300 can implement various routing techniques to allowsthe UAVs 50 to use associated flying lanes 700 to arrive and deliverpackages. Thus, one aspect of flying lane management, especially fordelivery applications, is efficiency since efficient routing can savetime, fuel, etc. which is key for deliveries.

Referring to FIG. 12, in an exemplary embodiment, a diagram illustratesobstruction detection by the UAV 50 and associated changes to the flyinglane 700. One aspect of flying lane management is detected obstructionmanagement. Here, the UAV 50 has taken off, have the flying lane 700,and is in communication with the air traffic control system 300. Duringthe flight, either the UAV 50 detects an obstacle 710 or the air trafficcontrol system 300 is notified from another source of the obstacle 710and alerts the UAV 50. Again, the UAVs 50 are flying at lower altitudes,and the obstacle 710 can be virtually anything that is temporary such asa crane, a vehicle, etc. or that is permanent such as a building, tree,etc. The UAV 50 is configured, with assistance and control from the airtraffic control system 300 to adjust the flying lane 700 to overcome theobstacle 710 as well as add a buffer amount, such as 35 feet or anyother amount for safety.

Referring to FIG. 13, in an exemplary embodiment, a flowchartillustrates a flying lane management method 750 via an air trafficcontrol system communicatively coupled to a UAV via one or more wirelessnetworks. In an exemplary embodiment, the flying lane management method750 includes initiating communication to the one or more UAVs at apreflight stage for each, wherein the communication is via one or morecell towers associated with the one or more wireless networks, whereinthe plurality of UAVs each include hardware and antennas adapted tocommunicate to the plurality of cell towers (step 752); determining aflying lane for the one or more UAVs based on a destination, current airtraffic in a region under management of the air traffic control system,and based on detected obstructions in the region (step 754); andproviding the flying lane to the one or more UAVs are an approval totake off and fly along the flying lane (step 756). The flying lanemanagement method 750 can further include continuing the communicationduring flight on the flying lane and receiving data from the one or moreUAVs, wherein the data includes feedback during the flight (step 758);and utilizing the feedback to update the flying lane, to update otherflying lanes, and to manage air traffic in the region (step 760). Duringthe flight, the feedback includes speed, altitude, and heading, and thefeedback can further include one or more of temperature, humidity, wind,and detected obstructions.

The flying lane management method 750 can further include providingupdates to the flying lane based on the feedback and based on feedbackfrom other devices. The flying lane management method 750 can furtherinclude, based on the feedback, determining the one or more UAVs atready to descend or fly to the destination and providing authorizationto the one or more UAVs for a descent. The flying lane management method750 can further include, based on the feedback, detecting a newobstruction; and one of updating the flying lane based on adjustmentsmade by the one or more UAVs due to the new obstruction and providing anupdated flying lane due to the new obstruction. The adjustments and/orthe updated flying lane can include a buffer distance from the newobstruction. The new obstruction can be detected by the one or more UAVsbased on hardware thereon and communicated to the air traffic controlsystem. The air traffic control system can be adapted to operateautonomously.

In another exemplary embodiment, an air traffic control systemcommunicatively coupled to one or more Unmanned Aerial Vehicles (UAVs)via one or more wireless networks adapted to perform flying lanemanagement includes a network interface and one or more processorscommunicatively coupled to one another; and memory storing instructionsthat, when executed, cause the one or more processors to: initiatecommunication to the one or more UAVs at a preflight stage for each,wherein the communication is via one or more cell towers associated withthe one or more wireless networks, wherein the plurality of UAVs eachinclude hardware and antennas adapted to communicate to the plurality ofcell towers; determine a flying lane for the one or more UAVs based on adestination, current air traffic in a region under management of the airtraffic control system, and based on detected obstructions in theregion; and provide the flying lane to the one or more UAVs are anapproval to take off and fly along the flying lane. The instructions,when executed, can further cause the one or more processors to: continuethe communication during flight on the flying lane and receiving datafrom the one or more UAVs, wherein the data include feedback during theflight; and utilize the feedback to update the flying lane, to updateother flying lanes, and to manage air traffic in the region.

During the flight, the feedback includes speed, altitude, and heading,and the feedback can further include one or more of temperature,humidity, wind, and detected obstructions. The instructions, whenexecuted, can further cause the one or more processors to: provideupdates to the flying lane based on the feedback and based on feedbackfrom other devices. The instructions, when executed, can further causethe one or more processors to based on the feedback, determine the oneor more UAVs at ready to descend or fly to the destination and providingauthorization to the one or more UAVs for a descent. The instructions,when executed, can further cause the one or more processors to based onthe feedback, detect a new obstruction; and one of update the flyinglane based on adjustments made by the one or more UAVs due to the newobstruction and provide an updated flying lane due to the newobstruction. The adjustments and/or the updated flying lane can includea buffer distance from the new obstruction. The new obstruction can bedetected by the one or more UAVs based on hardware thereon andcommunicated to the air traffic control system. The air traffic controlsystem can be adapted to operate autonomously.

§ 11.0 Air Traffic Control Monitoring Systems and Methods

Referring to FIG. 14, in an exemplary embodiment, a block diagramillustrates functional components of a consolidated UAV air trafficcontrol monitoring system 300A. The monitoring system 300A is similar tothe UAV air traffic control system 300 described herein. Specifically,the monitoring system 300A includes the cell network 302 (or multiplecell networks 302) as well as the other wireless networks 304. The oneor more servers 200 are communicatively coupled to the networks 302, 304in a similar manner as in the UAV air traffic control system 300 as wellas the UAVs 50 communication with the servers 200. Additionally, themonitoring system 300A includes one or more consolidated servers 200Awhich are communicatively coupled to the servers 200.

The consolidated servers 200A are configured to obtain a consolidatedview of all of the UAVs 50. Specifically, the UAVs 50 are geographicallydistributed as are the networks 302, 304. The servers 200 providegeographic or zone coverage. For example, the servers 200 may besegmented along geographic boundaries, such as different cities, states,etc. The consolidated servers 200A are configured to provide a view ofall of the servers 200 and their associated geographic or zone coverage.Specifically, the consolidated servers 200A can be located in a nationalAir Traffic Control center. From the consolidated servers 200A, any airtraffic control functions can be accomplished for the UAVs 50. Theconsolidated servers 200A can aggregate data on all of the UAVs 50 basedon multiple sources, i.e., the servers 200, and from multiple networks302, 304.

Thus, from the consolidated servers 200A, UAV traffic can be managedfrom a single point. The consolidated servers 200A can perform any ofthe air traffic control functions that the servers 200 can perform. Forexample, the consolidated servers 200A can be used to eliminateaccidents, minimize delay and congestion, etc. The consolidate servers200A can handle connectivity with hundreds or thousands of the servers200 to manage millions or multiple millions of UAVs 50. Additionally,the consolidated servers 200A can provide an efficient Graphical UserInterface (GUI) for air traffic control.

Referring to FIG. 15, in an exemplary embodiment, a screen shotillustrates a Graphical User Interface (GUI) providing a view of theconsolidated UAV air traffic control monitoring system. Specifically,the GUI can be provided by the consolidated servers 200A to providevisualization, monitoring, and control of the UAVs 50 across a widegeography, e.g., state, region, or national. In FIG. 15, the GUIprovides a map visualization at the national level, consolidating viewsfrom multiple servers 200. Various circles are illustrated with shading,gradients, etc. to convey information such as congestion in a localregion.

A user can drill-down such as by clicking any of the circles orselecting any geographic region to zoom in. The present disclosurecontemplates zooming between the national level down to local or evenstreet levels to view individual UAVs 50. The key aspect of the GUI isthe information display is catered to the level of UAV 50 traffic. Forexample, at the national level, it is not possible to display every UAV50 since there are orders of magnitude more UAVs 50 than airplanes.Thus, at higher geographic levels, the GUI can provide a heat map or thelike to convey levels of UAV 50 congestion. As the user drills-down tolocal geographies, individual UAVs 50 can be displayed.

Using the GUI, the consolidated servers 200A, and the servers 200,various air traffic control functions can be performed. One aspect isthat control can be high-level (coarse) through individual-level (fine)as well as in-between. That is, control can be at a large geographiclevel (e.g., city or state), at a local level (city or smaller), and atan individual UAV 50 level. The high-level control can be performed viasingle commands through the consolidated server 200A that is propagateddown to the servers 200 and to the UAVs 50. Examples of high-levelcontrol include no-fly zones, congestion control, traffic management,holding patterns, and the like. Examples of individual-level controlinclude flight plan management; separation assurance; real-time control;monitoring of speed, altitude, location, and direction; weather andobstacle reporting; landing services; and the like.

In addition to the communication from the consolidated servers 200A tothe UAVs 50, such as through the servers 200, for air traffic controlfunctions, there can be two-way communication as well. In an exemplaryembodiment, the UAVs 50 are configured to provide a first set of data tothe servers 200, such as speed, altitude, location, direction, weatherand obstacle reporting. The servers 200 are configured to provide asecond set of data to the consolidated servers 200A, such as a summaryor digest of the first data. This hierarchical data handling enables theconsolidated servers 200A to handle nationwide control of millions ofUAVs 50.

For example, when there is a view at the national level, theconsolidated servers 200A can provide summary information for regions,such as illustrated in FIG. 15. This is based on the second set of datawhich can provide a summary view of the GUI, such as how many UAVs 50are in a region. When there is a drill-down to a local level, theconsolidated servers 200A can obtain more information from the servers,i.e., the first set of data, allowing the consolidated servers 200A toact in a similar manner as the servers 200 for local control.

Referring to FIG. 16, in an exemplary embodiment, a flowchartillustrates a UAV air traffic control and monitor method 800. The method800 includes communicating with a plurality of servers each configuredto communicate with a plurality of UAVs in a geographic or zone coverage(step 802); consolidating data from the plurality of servers to providea visualization of a larger geography comprising a plurality ofgeographic or zone coverages (step 804); providing the visualization viaa Graphical User Interface (GUI) (step 806); and performing one or morefunctions via the GUI for air traffic control and monitoring at any of ahigh-level and an individual UAV level (step 808). The visualization caninclude a heat map of congestion at the larger geography and a view ofindividual UAVs via a drill-down. For the individual UAV level, theconsolidating the data can include obtaining a first set of data and,for the high-level, the consolidating the data can include obtaining asecond set of data which is a summary or digest of the first set ofdata. The first set of data can include speed, altitude, location,direction, weather and obstacle reporting from individual UAVs.

For the individual UAV level, the air traffic control and monitoring caninclude any of flight plan management; separation assurance; real-timecontrol; monitoring of speed, altitude, location, and direction; weatherand obstacle reporting; landing services, and wherein, for thehigh-level, the air traffic control and monitoring can include any ofno-fly zones, congestion control, traffic management, and hold patterns.The plurality of UAVs can be configured to constrain flight based oncoverage of a plurality of cell towers, wherein the constrained flightcan include one or more of pre-configuring the plurality of UAVs tooperate only where the coverage exists, monitoring cell signal strengthby the plurality of UAVs and adjusting flight based therein, and acombination thereof. One or more of the plurality of UAVs are configuredfor autonomous operation through the air traffic control. The pluralityof UAVs each can include circuitry adapted to communicate via aplurality of cellular networks to the plurality of servers. Theplurality of cellular networks can include a first wireless network anda second wireless network each provide bi-directional communicationbetween the UAV and the plurality of servers for redundancy with one ofthe first wireless network and the second wireless network operating asprimary and another as a backup.

In another exemplary embodiment, an Unmanned Aerial Vehicle (UAV) airtraffic control and monitoring system includes a network interface andone or more processors communicatively coupled to one another; andmemory storing instructions that, when executed, cause the one or moreprocessors to: communicate with a plurality of servers each configuredto communicate with a plurality of UAVs in a geographic or zonecoverage; consolidate data from the plurality of servers to provide avisualization of a larger geography comprising a plurality of geographicor zone coverages; provide the visualization via a Graphical UserInterface (GUI); and perform one or more functions via the GUI for airtraffic control and monitoring at any of a high-level and an individualUAV level.

In a further exemplary embodiment, a non-transitory computer-readablemedium includes instructions that, when executed, cause one or moreprocessors to perform steps of: communicating with a plurality ofservers each configured to communicate with a plurality of UAVs in ageographic or zone coverage; consolidating data from the plurality ofservers to provide a visualization of a larger geography comprising aplurality of geographic or zone coverages; providing the visualizationvia a Graphical User Interface (GUI); and performing one or morefunctions via the GUI for air traffic control and monitoring at any of ahigh-level and an individual UAV level.

§ 12.0 Obstruction Detection, Identification, and Management Systems andMethods

Referring to FIGS. 17 and 18, in an exemplary embodiment, block diagramsillustrate the UAV air traffic control system 300 describingfunctionality associated with obstruction detection, identification, andmanagement with FIG. 17 describing data transfer from the UAVs 50 to theservers 200 and FIG. 18 describing data transfer to the UAVs 50 from theservers 200. As described herein, obstructions include, withoutlimitation, other UAVs 50 based on their flight plan and objects at ornear the ground at a height above ground of several hundred feet. Again,the UAVs 50 typically fly at low altitudes such as 100′-500′ andobstruction management is important based on this low level of flight.

The obstructions can be stored and managed in an obstruction database(DB) 820 communicatively coupled to the servers 200 and part of the UAVair traffic control system 300. Obstructions can be temporary orpermanent and managed accordingly. Thus, the DB 820 can include an entryfor each obstruction with location (e.g., GPS coordinates), size(height), and permanence. Temporary obstructions can be ones that aretransient in nature, such as a scaffold, construction equipment, otherUAVs 50 in flight, etc. Permanent obstructions can be buildings, powerlines, cell towers, geographic (mountains), etc. For the permanence,each entry in the DB 820 can either be marked as permanent or temporarywith a Time to Remove (TTR). The TTR can be how long the entry remainsin the DB 820. The permanence is determined by the servers 200 asdescribed herein.

The obstruction detection, identification, and management is performedin the context of the UAV air traffic control system 300 describedherein with communication between the UAVs 50 and the servers 200 viathe wireless networks 302, 304. FIGS. 17 and 18 illustrate functionalityin the UAV air traffic control system 300 with FIGS. 17 and 18 separateto show different data flow and processing.

In FIG. 17, the UAVs 50 communicates to the servers 200 through thewireless networks 302, 304. Again, as described herein, the UAVs 50 haveadvanced data capture capabilities, such as video, photos, locationcoordinates, altitude, speed, wind, temperature, etc. Additionally, someUAVs 50 can be equipped with radar to provide radar data surveyingproximate landscape. Collectively, the data capture is performed by datacapture equipment associated with the UAVs 50.

Through the data capture equipment, the UAVs 50 are adapted to detectpotential obstructions and detect operational data (speed, direction,altitude, heading, location, etc.). Based on one or more connections tothe wireless networks 302, 304, the UAVs 50 are adapted to transfer theoperational data to the servers 200. Note, the UAV 50 can be configuredto do some local processing and transmit summaries of the operationaldata to reduce the transmission load on the wireless networks 302, 304.For example, for speed, heading, etc., the UAVs 50 can transmit deltainformation such that the servers 200 can track the flight plan. Note,the transmission of the operational data is performed throughout theflight such that the servers 200 can manage and control the UAVs 50.

For obstructions, the UAVs 50 can capture identification data, photos,video, etc. In an exemplary embodiment, the UAVs 50 are providedadvanced notification of obstructions (in FIG. 18) and capable of localdata processing of the identification data to verify the obstructions.If the local data processing determines an obstruction is already known,i.e., provided in a notification from the servers 200, the UAV 50 doesnot require any further processing or data transfer of theidentification data, i.e., this obstruction is already detected. On theother hand, if the UAV 50 detects a potential obstruction, i.e., onethat it has not been notified of, based on the local data processing,the UAV 50 can perform data transfer of the identification data to theservers 200.

The servers 200 are configured to manage the obstruction DB 820, namelyto update the entries therein. The servers 200 are configured to receiveoperational data from the UAVs 50 under control for management thereof.Specifically, the servers 200 are configured to manage the flight plansof the UAVs 200, and, in particular with respect to obstructions, foradvanced notification of future obstructions in the flight plan.

The servers 200 are configured to receive the detection of potentialobstructions. The UAVs 200 can either simply notify the servers 200 of apotential obstruction as well as provide the identification data for theservers 200 to perform identification and analysis. Upon receipt of anydata from the UAVs 200 related to obstructions (a mere notification,actual photos, etc.), the servers 200 are configured to correlate thisdata with the DB 820. If the data correlates to an entry that exists inthe DB 820, the servers 200 can update the entry if necessary, e.g.,update any information related to the obstruction such as last seendate.

If the servers 200 detect the potential obstruction does not exist inthe DB 820, the servers 200 are configured to add an entry in the DB820, perform identification if possible from the identification data,and potentially instruct a UAV 50 to identify in the future. Forexample, if the servers 200 can identify the potential obstruction fromthe identification data, the servers 200 can create the DB 820 entry andpopulate it with the identified data. The servers 200 can analyze theidentification data, as well as request human review, using patternrecognition to identify what the obstruction is, what itscharacteristics are (height, size, permanency, etc.).

If the servers 200 do not have enough identification data, the servers200 can instruct the identifying UAV 50 or another UAV 50 in proximityin the future to obtain specific identification data for the purposes ofidentification.

In FIG. 18, the servers 200 continue to manage the DB 820, both forpopulating/managing entries as well as to provide notifications ofobstructions in the flight plans of each of the UAVs 50. Specifically,the servers 200 are configured to keep track of the flight plans of allof the UAVs 50 under its control. As part of this tracking, the servers200 are configured to correlate the operational data to derive theflight plan and to determine any obstructions from the DB 820 in theflight plan. The servers 200 are configured to provide notificationsand/or instructions to the UAVs 50 based on upcoming obstructions.

Additionally, the servers 200 are configured to provide instructions toUAVs 50 to capture identification data for potential obstructions thatare not yet identified. Specifically, the servers 200 can instruct theUAVs 50 on what exact data to obtain, e.g., pictures, video, etc., andfrom what angle, elevation, direction, location, etc. With theidentification data, the servers 200 can perform various processes topattern match the pictures with known objects for identification. Incase an obstruction is not matched, it can be flagged for human review.Also, the human review can be performed based on successful matches tograde the performance and to improve pattern matching techniquesfurther. Identification of the obstruction is important for permanencydeterminations. For example, a new high-rise building is permanentwhereas a construction crane is temporary.

For the TTR, temporary obstructions are automatically removed in the DB820 based on this entry. In an exemplary embodiment, the TTR can be aflag with a specified time. In another exemplary embodiment, the TTR canbe a flag which requires removal if the next UAV 50 passing near theobstruction fails to detect and report it.

Referring to FIG. 19, in an exemplary embodiment, a flowchartillustrates an obstruction detection and management method 900implemented through the UAV air traffic control system 300 for the UAVs50. The obstruction detection and management method 900 includesreceiving UAV data from a plurality of UAVs, wherein the UAV datacomprises operational data for the plurality of UAVs and obstructiondata from one or more UAVs (step 902); updating an obstruction databasebased on the obstruction data (step 904); monitoring a flight plan forthe plurality of UAVs based on the operational data (step 906); andtransmitting obstruction instructions to the plurality of UAVs based onanalyzing the obstruction database with their flight plan (step 908).

The obstruction data can include an indication of a potentialobstruction which was not provided to a UAV in the obstructioninstructions. The obstruction data can include a confirmation of anobstruction based on the obstruction instructions, and wherein theupdating can include noting any changes in the obstruction based on theconfirmation. The obstruction instructions can include a request to aUAV to perform data capture of a potential obstruction, wherein theobstruction data can include photos and/or video of the potentialobstruction, and wherein the updating can include identifying thepotential obstruction based on the obstruction data.

The obstruction database can include entries of obstructions with theirheight, size, location, and a permanency flag comprising either atemporary obstruction or a permanent obstruction. The permanency flagcan include a Time To Remove (TTR) for the temporary obstruction whichis a flag with a specified time or a flag which requires removal if thenext UAV passing near the temporary obstruction fails to detect andreport it. The operational data can include a plurality of speed,location, heading, and altitude, and wherein the flight plan isdetermined from the operational data. The plurality of UAVs fly underabout 1000′.

In another exemplary embodiment, an Unmanned Aerial Vehicle (UAV) airtraffic control and monitoring system for obstruction detection andmanagement includes a network interface and one or more processorscommunicatively coupled to one another; and memory storing instructionsthat, when executed, cause the one or more processors to receive UAVdata from a plurality of UAVs, wherein the UAV data includes operationaldata for the plurality of UAVs and obstruction data from one or moreUAVs; update an obstruction database based on the obstruction data;monitor a flight plan for the plurality of UAVs based on the operationaldata; and transmit obstruction instructions to the plurality of UAVsbased on analyzing the obstruction database with their flight plan.

A non-transitory computer-readable medium comprising instructions that,when executed, cause one or more processors to perform steps of:receiving Unmanned Aerial Vehicle (UAV) data from a plurality of UAVs,wherein the UAV data includes operational data for the plurality of UAVsand obstruction data from one or more UAVs; updating an obstructiondatabase based on the obstruction data; monitoring a flight plan for theplurality of UAVs based on the operational data; and transmittingobstruction instructions to the plurality of UAVs based on analyzing theobstruction database with their flight plan.

§ 13.0 Managing Detected Static Obstructions

Referring to FIG. 20, in an exemplary embodiment, a diagram illustratesgeographical terrain 1000 with exemplary static obstructions 1002, 1004,1006. As described herein, static obstructions are at or near the groundand can be temporary or permanent. Again, since the UAVs 50 fly muchlower than conventional aircraft, these obstructions need to be managedand communicated to the UAVs 50. A dynamic obstruction can includemoving objects such as other UAVs 50, vehicles on the ground, etc.Management of dynamic obstructions besides other UAVs 50 is difficult inthe UAV air traffic control system 300 due to their transient nature. Inan exemplary embodiment, the UAVs 50 themselves can include localtechniques to avoid detected dynamic obstructions. The UAV air trafficcontrol system 300 can be used to ensure all controlled UAVs 50 knowabout and avoid other proximate UAVs 50. Static obstructions, on theother hand, can be efficiently managed and avoided through the UAV airtraffic control system 300. The UAV air traffic control system 300 canbe used to detect the static obstructions through a combination ofcrowd-sourcing data collection by the UAVs 50, use of external databases(mapping programs, satellite imagery, etc.), and the like. The UAV airtraffic control system 300 can also be used to communicate the detectedstatic obstructions to proximate UAVs 50 for avoidance thereof

Non-limiting examples of static obstructions which are permanent includebuildings, mountains, cell towers, utility lines, bridges, etc.Non-limiting examples of static obstructions which are temporary includetents, parked utility vehicles, etc. From the UAV air traffic controlsystem 300, these temporary and permanent static obstructions can bemanaged the same with the temporary obstructions having a Time To Remove(TTR) parameter which can remove it from the database 820.

The static obstructions can take various forms with different sizes,heights, etc. The static obstruction 1002 is substantially rectangular,e.g., a building or the like. The static obstruction 1004 can besubstantially cylindrical, e.g., a cell tower, pole, or the like. Thestatic obstruction 1006 can be irregularly shaped, e.g., a mountain,building, or the like.

Referring to FIG. 21, in an exemplary embodiment, diagrams illustratedata structures 1010, 1012 which can be used to define the exactlocation of any of the static obstructions 1002, 1004, 1006. The UAV airtraffic control system 300 can use these data structures 1010, 1012 tostore information in the database 820 regarding the associated staticobstructions 1002, 1004, 1006. In an exemplary embodiment, the UAV airtraffic control system 300 can use one or both of these data structures1010, 1012 to define a location of the static obstructions 1002, 1004,1006. This location can be a no-fly zone, i.e., avoided by the UAVs 50.The UAV air traffic control system 300 can use the data structure 1010for the static obstruction 1002, 1006 and the data structure 1012 forthe static obstruction 1004. In this manner, the UAVs 50 can knowexactly where the static obstructions 1002, 1004, 1006 are located andfly accordingly.

The data structures 1010, 1012 can be managed by the UAV air trafficcontrol system 300 based on data collection by the UAVs 50 and/or othersources. The data structures 1010, 1012 can be stored in the database820 along with the TTR parameter for temporary or permanent.

To populate and manage the data structures 1010, 1012, i.e., toidentify, characterize, and verify, the UAV air traffic control system300 communicates with the UAVs 50 and/or with external sources. For theUAVs 50, the UAVs 50 can be configured to detect the static obstructions1002, 1004, 1006; collect relevant data such as locations, pictures,etc. for populating the data structures 1010, 1012; collect the relevantdata at the direction of the UAV air traffic control system 300; provideverification the static obstructions 1002, 1004, 1006 subsequent to theUAV air traffic control system 300 notifying the UAVs 50 foravoidance/verification; and the like.

In an exemplary aspect, the UAVs 50, upon detecting an unidentifiedstatic obstruction 1002, 1004, 1006, the UAVs 50 can collect therelevant data and forward to the UAV air traffic control system 300. TheUAV air traffic control system 300 can then analyze the relevant data topopulate the data structures 1010, 1012. If additional data is requiredto fully populate the data structures 1010, 1012, the UAV air trafficcontrol system 300 can instruct another UAV 50 at or near the detectedstatic obstruction 1002, 1004, 1006 to collect additional data. Forexample, assume a first UAV 50 detects the static obstruction 1002,1004, 1006 from the east, collects the relevant data, but this is notenough for the UAV air traffic control system 300 to fully populate thedata structures 1010, 1012, the UAV air traffic control system 300 caninstruct a second UAV 50 to approach and collect data from the west.

The UAVs 50 with communication between the UAV air traffic controlsystem 300 can perform real-time detection of the static obstructions1002, 1004, 1006. Additionally, the UAV air traffic control system 300can utilize external sources for offline detection of the staticobstructions 1002, 1004, 1006. For example, the external sources caninclude map data, public record data, satellite imagery, and the like.The UAV air traffic control system 300 can parse and analyze thisexternal data offline to both populate the data structures 1010, 1012 aswell as very the integrity of existing data in the data structures 1010,1012.

Once the data structures 1010, 1012 are populated in the database 820,the UAV air traffic control system 300 can use this data to coordinateflights with the UAVs 50. The UAV air traffic control system 300 canprovide relevant no fly zone data to UAVs 50 based on their location.The UAV air traffic control system 300 can also manage UAV landing zonesbased on this data, keeping emergency landing zones in differentlocations based on the static obstructions 1002, 1004, 1006; managingrecharging locations in different locations based on the staticobstructions 1002, 1004, 1006; and managing landing locations based onthe static obstructions 1002, 1004, 1006.

Referring to FIG. 22, in an exemplary embodiment, a flowchartillustrates a static obstruction detection and management method 1050through an Air Traffic Control (ATC) system for Unmanned Aerial Vehicles(UAVs). The static obstruction detection and management method 1050includes receiving UAV data from a plurality of UAVs related to staticobstructions (step 1052); receiving external data from one or moreexternal sources related to the static obstructions (step 1054);analyzing the UAV data and the external data to populate and manage anobstruction database of the static obstructions (step 1056); andtransmitting obstruction instructions to the plurality of UAVs based onanalyzing the obstruction database with their flight plan (step 1058).

The obstruction database can include a plurality of data structures eachdefining a no fly zone of location coordinates based on the analyzing.The data structures define one of a cylinder and a rectangle sized tocover an associated obstruction and with associated locationcoordinates. The data structures each can include a time to removeparameter defining either a temporary or a permanent obstruction. One ofthe UAV data and the external data can be used first to detect anobstruction and enter the obstruction in the obstruction database, andthe other of the UAV data and the external data is used to verify theobstruction in the obstruction database. The static obstructiondetection and management method 1050 can further include transmittinginstructions to one or more UAVs to obtain additional information topopulate and manage the obstruction database. The static obstructiondetection and management method 1050 can further include managing one ormore of emergency landing locations, recharging locations, and landinglocations for the plurality of UAVs based on the obstruction database.The plurality of UAVs fly under about 1000′ and the obstructions arebased thereon.

§ 14.0 UAV Configuration

Referring to FIG. 23, in an exemplary embodiment, a block diagramillustrates functional components implemented in physical components inthe UAV 50 for use with the air traffic control system 300, such as fordynamic and static obstruction detection. This exemplary embodiment inFIG. 23 can be used with any of the UAV 50 embodiments described herein.The UAV 50 can include a processing device 1100, flight components 1102,cameras 1104, radar 1106, wireless interfaces 1108, a data store/memory1110, a spectrum analyzer 1120, and a location device 1122. Thesecomponents can be integrated with, disposed on, associated with the body82 of the UAV 50. The processing device 1100 can be similar to themobile device 100 or the processor 102. Generally, the processing device1100 can be configured to control operations of the flight components1102, the cameras 1104, the radar 1106, the wireless interfaces 1108,and the data store/memory 1110.

The flight components 1102 can include the rotors 80 and the like.Generally, the flight components 1102 are configured to control theflight, i.e., speed, direction, altitude, heading, etc., of the UAV 50responsive to control by the processing device 1100.

The cameras 1104 can be disposed on or about the body 82. The UAV 50 caninclude one or more cameras 1104, for example, facing differentdirections as well as supporting pan, tilt, zoom, etc. Generally, thecameras 1104 are configured to obtain images and video, including highdefinition. In an exemplary embodiment, the UAV 50 includes at least twocameras 1104 such as a front-facing and a rear-facing camera. Thecameras 1104 are configured to provide the images or video to theprocessing device 1100 and/or the data store/memory 1110. Thefront-facing camera can be configured to detect obstructions in front ofthe UAV 50 as it flies and the rear-facing camera can be configured toobtain additional images for further characterization of the detectedobstructions.

The radar 1106 can be configured to detect objects around the UAV 50 inaddition to the cameras 1104, using standard radar techniques. Thewireless interfaces 1108 can be similar to the wireless interfaces 106with similar functionality. The data store/memory 1110 can be similar tothe data store 108 and the memory 110. The wireless interfaces 1108 canbe used to communicate with the air traffic control system 300 over oneor more wireless networks as described herein.

Collectively, the components in the UAV 50 are configured to fly the UAV50, and concurrent detect and identify obstructions during the flight.In an exemplary embodiment, the radar 1106 can detect an obstructionthrough the processing device 1100, the processing device 1100 can causethe cameras 1104 to obtain images or video, the processing device 1100can cause adjustments to the flight plan accordingly, and the processingdevice 1100 can identify aspects of the obstruction from the images orvideo. In another exemplary embodiment, the camera 1104 can detect theobstruction, the processing device 1100 can cause adjustments to theflight plan accordingly, and the processing device 1100 can identifyaspects of the obstruction from the images or video. In a furtherexemplary embodiment, the front-facing camera or the radar 1106 candetect the obstruction, the processing device 1100 can cause therear-facing and/or the front-facing camera to obtain images or video,the processing device 1100 can cause adjustments to the flight planaccordingly, and the processing device 1100 can identify aspects of theobstruction from the images or video.

In all the embodiments, the wireless interfaces 1108 can be used tocommunicate information about the detected obstruction to the airtraffic control system 300. This information can be based on the localprocessing by the processing device 1100, and the information caninclude, without limitation, size, location, shape, type, images,movement characteristics, etc.

For dynamic obstructions, the UAV 50 can determine movementcharacteristics such as from multiple images or video. The movementcharacteristics can include speed, direction, altitude, etc. and can bederived from analyzing the images of video over time. Based on thesecharacteristics, the UAV 50 can locally determine how to avoid thedetected dynamic obstructions.

Additionally, the air traffic control system 300 can keep track of allof the UAVs 50 under its control or management. Moving UAVs 50 are oneexample of dynamic obstructions. The air traffic control system 300 cannotify the UAVs 50 of other UAVs 50 and the UAVs 50 can also communicatethe detection of the UAVs 50 as well as other dynamic and staticobstructions to the air traffic control system 300.

The spectrum analyzer 1120 is configured to measure wirelessperformance. The spectrum analyzer 1120 can be incorporated in the UAV50, attached thereto, etc. The spectrum analyzer 1120 is communicativelycoupled to the processing device 1100 and the location device 1122. Thelocation device 1122 can be a Global Positioning Satellite (GPS) deviceor the like. Specifically, the location device 1122 is configured todetermine a precise location of the UAV 50. The spectrum analyzer 1120can be configured to detect signal bandwidth, frequency, and RadioFrequency (RF) strength. These can collectively be referred to asmeasurements, and they can be correlated to the location where takenfrom the location device 1122.

Referring to FIG. 24, in an exemplary embodiment, a flowchartillustrates a UAV method 1200 for obstruction detection. The UAVincludes flight components attached or disposed to a base; one or morecameras; radar; one or more wireless interfaces; and a processing devicecommunicatively coupled to the flight components, the one or morecameras, the radar, and the wireless interfaces. The UAV method 1200includes monitoring proximate airspace with one or more of one or morecameras and radar (step 1202); detecting an obstruction based on themonitoring (step 1204); identifying characteristics of the obstruction(step 1206); altering a flight plan, through the flight components, ifrequired based on the characteristics (step 1208); and communicating theobstruction to an air traffic control system via one or more wirelessinterfaces (step 1210).

The detecting can be via the radar and the method 1200 can furtherinclude causing the one or more cameras to obtain images or video of thedetected obstruction at a location based on the radar; and analyzing theimages or video to identify the characteristics. The detecting can bevia the one or more cameras and the method 1200 can further includeanalyzing images or video from the one or more cameras to identify thecharacteristics. The one or more cameras can include a front-facingcamera and a rear-facing camera and the method 1200 can further includecausing one or more of the front-facing camera and the rear-facingcamera to obtain additional images or video; and analyzing the images orvideo to identify the characteristics. The obstructions can includedynamic obstructions, and the characteristics comprise size, shape,speed, direction, altitude, and heading. The characteristics can bedetermined based on analyzing multiple images or video over time. TheUAV method 1200 can further include receiving notifications from the airtraffic control system related to previously detected obstructions; andupdating the air traffic control system based on the detection of thepreviously detected obstructions. The characteristics are for anobstruction database maintained by the air traffic control system.

§ 15.0 Waypoint Directory

In an exemplary embodiment, the UAV air traffic control system 300 usesa plurality of waypoints to manage air traffic in a geographic region.Again, waypoints are sets of coordinates that identify a point inphysical space. The waypoints can include longitude and latitude as wellas an altitude. For example, the waypoints can be defined over somearea, for example, a square, rectangle, hexagon, or some other geometricshape, covering some amount of area. It is not practical to define awaypoint as a physical point as this would lead to an infinite number ofwaypoints for management by the UAV air traffic control system 300.Instead, the waypoints can cover a set area, such every foot to hundredfeet or some other distance. In an exemplary embodiment, the waypointscan be set between 1′ to 50′ in dense urban regions, between 1′ to 100′in metropolitan or suburban regions, and between 1′ to 1000′ in ruralregions. Setting such sized waypoints provides a manageable approach inthe UAV air traffic control system 300 and for communication over thewireless networks with the UAVs 50. The waypoints can also include analtitude. However, since UAV 50 flight is generally constrained toseveral hundred feet, the waypoints can either altitude or segment thealtitude in a similar manner as the area. For example, the altitude canbe separated in 100′ increments, etc. Accordingly, the defined waypointscan blanket an entire geographic region for management by the UAV airtraffic control system 300.

The waypoints can be detected by the UAVs 50 using locationidentification components such as GPS. A typical GPS receiver can locatea waypoint with an accuracy of three meters or better when used withland-based assisting technologies such as the Wide Area AugmentationSystem (WAAS). Waypoints are managed by the UAV air traffic controlsystem 300 and communicated to the UAVs 50, and used for a varietypurposes described herein. In an exemplary embodiment, the waypoints canbe used to define a flight path for the UAVs 50 by defining a start andend waypoint as well as defining a plurality of intermediate waypoints.

The waypoints for a given geographic region (e.g., a city, region,state, etc.) can be managed in a waypoint directory which is stored andmanaged in the DB 820. The DB 820 can include the waypoint directory andactively manage a status of each waypoint. For example, the status canbe either obstructed, clear, or unknown. With these classifications, theUAV air traffic control system 300 can actively manage UAV 50 flightpaths. The UAVs 50 can also check and continually update the DB 820through communication with the UAV air traffic control system 300. Theuse of the waypoints provides an efficient mechanism to define flightpaths.

§ 15.1 Use of Waypoints

The UAV air traffic control system 300 and the UAVs 50 can use thewaypoints for various purposes including i) flight path definition, ii)start and end point definition, iii) tracking of UAVs 50 in flight, iv)measuring the reliability and accuracy of information from particularUAVs 50, v) visualizations of UAV 50 flight, and the like. For flightpath definition, the waypoints can be a collection of points defininghow a particular UAV 50 should fly. In an exemplary embodiment, theflight path can be defined with waypoints across the entire flight path.In another exemplary embodiment, the flight path can be defined byvarious marker waypoints allowing the particular UAV 50 the opportunityto determine flight paths between the marker waypoints locally. In afurther exemplary embodiment, the flight path is defined solely by thestart and end waypoints, and the UAV 50 locally determines the flightpath based thereon.

In these embodiments, the intermediate waypoints are still monitored andused to manage the UAV 50 in flight. In an exemplary embodiment, the UAV50 can provide updates to the UAV air traffic control system 300 basedon obstruction detection as described herein. These updates can be usedto update the status of the waypoint directory in the DB 820. The UAVair traffic control system 300 can use the waypoints as a mechanism totrack the UAVs 50. This can include waypoint rules such as no UAV 50 canbe in a certain proximity of another UAV 50 based on the waypoints,speed, and direction. This can include proactive notifications based onthe current waypoint, speed, and direction, and the like.

In an exemplary embodiment, the waypoints can be used for measuring thereliability and accuracy of information from particular UAVs 50. Again,the waypoints provide a mechanism to define the geography. The UAV airtraffic control system 300 is configured to receive updates from UAVs 50about the waypoints. The UAV air traffic control system 300 candetermine the reliability and accuracy of the updates based oncrowd-sourcing the updates. Specifically, the UAV air traffic controlsystem 300 can receive an update which either confirms the currentstatus or changes the current status. For example, assume a waypoint iscurrently clear, and an update is provided which says the waypoint isclear, then this UAV 50 providing the update is likely accurate.Conversely, assume a waypoint is currently clear, and an update isprovided which says the waypoint is now obstructed, but a short timelater, another update from another UAV 50 says the waypoint is clear,this may reflect inaccurate information. Based on comparisons betweenUAVs 50 and their associated waypoint updates, scoring can occur for theUAVs 50 to determine reliability and accuracy. This is useful for theUAV air traffic control system 300 to implement status updatechanges—preference may be given to UAVs 50 with higher scoring.

The waypoints can also be used for visualization in the UAV air trafficcontrol system 300. Specifically, waypoints on mapping programs providea convenient mechanism to show location, start and end points, etc. Thewaypoints can be used to provide operators and pilots visual informationrelated to one or more UAVs 50.

Referring to FIG. 25, in an exemplary embodiment, a flowchartillustrates a waypoint management method 1250 for an Air Traffic Control(ATC) system for Unmanned Aerial Vehicles (UAVs). The waypointmanagement method 1250 includes communicating with a plurality of UAVsvia one or more wireless networks comprising at least one cellularnetwork (step 1252); receiving updates related to an obstruction statusof each of a plurality of waypoints from the plurality of UAVs, whereinthe plurality of waypoints are defined over a geographic region undercontrol of the ATC system (step 1254); and managing flight paths,landing, and take-off of the plurality of UAVs in the geographic regionbased on the obstruction status of each of the plurality of waypoints(step 1256). The plurality of waypoints each includes a latitude andlongitude coordinate defining a point about which an area is defined forcovering a portion of the geographic region. A size of the area can bebased on whether the area covers an urban region, a suburban region, anda rural region in the geographic area, wherein the size is smaller forthe urban region than for the suburban region and the rural region, andwherein the size is smaller for the suburban region than for the ruralregion. Each of the plurality of waypoints can include an altitude rangeset based on flight altitudes of the plurality of UAVs.

The ATC system can include an obstruction database comprising a datastructure for each of the plurality of waypoints defining a uniqueidentifier of a location and the obstruction status, and wherein theobstruction status comprises one of clear, obstructed, and unknown. Thewaypoint management method 1250 can further include updating theobstruction status for each of the plurality of waypoints in theobstruction database based on the received updates (step 1258). Thewaypoint management method 1250 can further include defining the flightpaths based on specifying two or more waypoints of the plurality ofwaypoints. A flight path can be defined by one of specifying a startwaypoint and an end waypoint and allowing a UAV to determine a paththerebetween locally; and specifying a start waypoint and an endwaypoint and a plurality of intermediate waypoints between the startwaypoint and the end waypoint. The waypoint management method 1250 canfurther include scoring each UAV's updates for the plurality ofwaypoints to determine reliability and accuracy of the updates.

In another exemplary embodiment, an Air Traffic Control (ATC) system forUnmanned Aerial Vehicles (UAVs) using waypoint management includes anetwork interface and one or more processors communicatively coupled toone another, wherein the network interface is communicatively coupled toa plurality of UAVs via one or more wireless networks; and memorystoring instructions that, when executed, cause the one or moreprocessors to communicate with a plurality of UAVs via one or morewireless networks comprising at least one cellular network; receiveupdates related to an obstruction status of each of a plurality ofwaypoints from the plurality of UAVs, wherein the plurality of waypointsare defined over a geographic region under control of the ATC system;and manage flight paths, landing, and take-off of the plurality of UAVsin the geographic region based on the obstruction status of each of theplurality of waypoints.

In a further exemplary embodiment, a non-transitory computer-readablemedium comprising instructions that, when executed, cause one or moreprocessors to perform steps of communicating with a plurality of UAVsvia one or more wireless networks comprising at least one cellularnetwork; receiving updates related to an obstruction status of each of aplurality of waypoints from the plurality of UAVs, wherein the pluralityof waypoints are defined over a geographic region under control of theATC system; and managing flight paths, landing, and take-off of theplurality of UAVs in the geographic region based on the obstructionstatus of each of the plurality of waypoints.

§ 16.0 Rogue or Distressed UAVs

As the number of UAVs 50 increase in a given geographical region, theUAV air traffic control system 300 advantageously provides unifiedmanagement in the given geographical region. Plus, utilizing existingwireless networks 302, 304, coverage is in place. With the increased UAV50 presence, there is a significant risk due to rogue or distressed UAVs50. That is, with increased air traffic, the risks of damage to people,property, vehicles, etc. significantly increases. As described herein, arogue UAV 50 is one which is unauthorized, flying in a no-fly zone,under the control of a rogue operator including a terrorist or someonewho bad intent, etc. A distressed UAV 50 is one which is malfunctioning,failed, unable to fly, suffering a power outage, etc. That is, with bothrogue and distressed UAVs 50 in flight the objective is to cause theimmediate shutdown and/or landing of these UAVs 50. Further, theobjective is to support the immediate shutdown and/or landing in amanner that reduces the risk of damage.

§ 16.1 Air Traffic Control Systems and Methods for Rogue or DistressedUAVs

Referring to FIG. 26, in an exemplary embodiment, a flowchartillustrates an air traffic control method 1300 for addressing rogue ordistressed UAVs. The air traffic control method 1300 includes detectingan Unmanned Aerial Vehicle (UAV) is one of distressed and rogue (step1302), determining timing for a shutdown and a location for landing(step 1304), and communicating the determined timing and the landinglocation to the UAV by the Air Traffic Control system via one or morewireless networks comprising at least one cellular network (step 1306).The air traffic control method 1300 can further include notifying one ormore persons of the determined timing and the landing location (step1308).

The detection of the UAV 50 as one of distressed and rogue can bethrough various techniques. For a distressed UAV, the detection can belocal at the UAV 50, e.g., a failure of some component, etc., and thedetection can be based on the UAV 50 communicating to the air trafficcontrol system 300. For example, the UAV 50 can be configured toperiodically provide operational data to the air traffic control system300 including detection of a local failure or distress condition. Also,for a distressed UAV, the detection can be by the air traffic controlsystem 300, such as based on loss of communication, analysis ofoperational parameters exchanged between the UAV 50 and the air trafficcontrol system 300, etc. For example, the air traffic control system 300can glean distress from the operational parameters such as a battery islow, rotors are inoperable, guidance is malfunctioning, etc. Further,for a distressed UAV, the detection can be external such as throughanother UAV 50 observing the distressed UAV, through surveillancecameras, based on manual input from observers (e.g., observers on theground signal the air traffic control system 300), etc.

Even further, the detection of a distressed UAV can be based on a lossof communication between the UAV 50 and the air traffic control system300. Again, the UAV 50 can periodically provide the operationalparameters including a HELLO message to verify continued communicationand the air traffic control system 300 can also provide correspondingACK messages, i.e., a two-way handshake to verify communication exists.In the event a certain number of messages are not received or a periodof time expires without the two-way handshake verifying communication,it can be assumed the UAV 50 is distressed and in need of landing. Theobjective here is to avoid having UAVs 50 in flight which are invisibleor not under the control of the air traffic control system 300.

For a rogue UAV, the detection can be local such as based on the UAV 50detecting it is flying in a no-fly zone or in an unauthorized area. Morelikely, the rogue UAV is detected externally such as through other UAVs50, the air traffic control system 300, or observers proximate to therogue UAV. Other UAVs 50 can detect proximate UAVs 50 and communicatethis to the air traffic control system 300. From this detection, the airtraffic control system 300 can detect rogue UAVs, i.e., unauthorized,unknown, flying erratically, malicious intent, etc. The rogue UAV canalso be detected by observers which notify the air traffic controlsystem 300.

The objective of determining the timing for a shutdown and a locationfor landing is for either the UAV 50 or the air traffic control system300 find a low-risk location to land. The determined timing can beimmediate or shortly thereafter with enough time for the UAV 50 totravel to a less risky location for the landing. In an exemplaryembodiment, the UAV 50 is configured to determine the timing and thelanding location. This can be in the case where there is nocommunication between the UAV 50 and the air traffic control system 300.Here, the UAV 50 can find a suitable landing location by itself such asbased on its GPS and a map of predetermined safe landing locations,i.e., fields, nonresidential areas, etc. The predetermined safe landinglocations can be provided to the UAV 50 by the air traffic controlsystem 300 when there is communication, prior to launch, orpreprogrammed into the UAV 50. Alternatively, the UAV 50 can make alocal decision based on its camera which monitors for safe locations.

In another exemplary embodiment, the determined timing and the landinglocation are determined by the air traffic control system 300. Here, theair traffic control system 300 can use its current knowledge of thegeographical region to direct the UAV 50 to a safe location safely. Theair traffic control system 300 can also maintain a map of predeterminedsafe landing locations. Of note, the air traffic control system 300 canmake a note of the distressed or rogue UAV and coordinate activityaccordingly.

In an exemplary embodiment, the communicating the determined timing andthe landing location can be by the air traffic control system 300 to theUAV 50. In another exemplary embodiment, the communicating can be fromthe UAV 50 locally, e.g., the processor 202 can communicate thedetermined timing and the location and cause the UAV 50 to proceed toland. The communicating the determined timing and the landing can bethrough guidance instructions, e.g., land at GPS location in the next30s. Also, the communicating the determined timing and the landing canbe through a “kill code” which automatically shuts off the UAV 50, suchas when the UAV 50 is already at a safe location for landing.

The notifying can include providing alerts, alarms, visual notification,etc. using various known techniques. For example, the notification canbe an alarm of varying levels—warning, minor, major, critical,immediate, etc. The notification can also be provided to nearby people,such as through SMS text alerts, etc. The method 1300 can also includecommunicating to other UAVs proximate to the UAV that is one ofdistressed and rogue and providing instructions for avoidance.

§ 16.2 UAV “Kill Code” and Commands

In various exemplary embodiments, the UAVs 50 can be configured forautomatic communication to the networks 302, 304. The UAVs 50 can beconfigured with so-called “kill codes” which allow the air trafficcontrol system 300 to remotely shut down the UAV 50. In anotherexemplary embodiment, another UAV 50 proximate to the UAV 50 can beconfigured to transmit the “kill code” point-to-point such as through alocal wireless connection. Variously, it is expected that any UAV 50that supports operation with the air traffic control system 300 ispreprogrammed to implement the various techniques herein to support safeand immediate emergency landings.

§ 17.0 3D Wireless Coverage Mapping Using UAVs

Referring to FIG. 27, in an exemplary embodiment, a flowchartillustrates a 3D wireless coverage mapping method 1400 using the UAV 50.The 3D wireless coverage mapping method 1400 is performed using the UAV50 specifically with the processing device 1100, the wireless interfaces1108, the spectrum analyzer 1120, and the location device 1122. In someembodiments, the UAV 50 does not include the spectrum analyzer 1120, butinstead only uses the wireless interfaces 1108 with the wirelessinterfaces 1108 configured for both communications on the wirelessnetworks 302, 304 and for measuring coverage of the wireless networks302, 304. In other embodiments, the spectrum analyzer 1120 is configuredto take measurements of the wireless networks 302, 304.

The objective of the 3D wireless coverage mapping method 1400 is toobtain wireless measurements of the wireless networks 302, 304 at one ormore different elevations using the UAV 50 and to create a 3D coveragemap, i.e., a cloud map, of the wireless coverage of the wirelessnetworks 302, 304. The UAV 50 is flown about the associated coverageareas 410, 412, 414 of the wireless networks 302, 304.

Once the 3D coverage map is created, an operator of the wirelessnetworks 302, 304 can perform remedial actions to address coverage gaps.This can include adding additional antennas to a cell tower 12associated with the cell site 10, adjusting patterns of existingantennas, adding new cell sites 10, and the like. Also, the UAV airtraffic control system 300 can use the 3D coverage map to ensure UAVs 50do not lose communication to the UAV air traffic control system 300.This can include so-called no-fly zones in areas of poor coverage basedon the 3D coverage map, instructions to the UAVs 50 to avoid the areasof poor coverage, etc.

The UAV 50, to develop the 3D coverage map, can fly in variousapproaches at the associated coverage areas 410, 412, 414. In anexemplary embodiment, the UAV 50 flies in a circular pattern (e.g.,either clockwise or counterclockwise) about the cell tower 12 at a setelevation (or at different elevations). In another exemplary embodiment,the UAV 50 flies in a zigzag pattern between adjacent cell towers 12 ata set elevation (or at different elevations). In various exemplaryembodiments, the UAV 50 can fly at different elevations to cover thearea above-the-ground where the UAVs 50 will fly and need coverage withthe UAV air traffic control system 300. This can include tower height,between several hundred to several thousand feet, etc.

Also, the UAV 50 can adapt its flight plan about the associated coverageareas 410, 412, 414 based on feedback from the spectrum analyzer 1120and/or the wireless interfaces 1108. For example, if the UAV 50 detectspoor coverage, the UAV 50 can focus on this area to determine itsreadings are correct. Alternatively, if the UAV 50 detects goodcoverage, the UAV 50 can avoid detailed flights.

The method 1400 provides three-dimensional (3D) coverage mapping of acoverage area of a cell site using an Unmanned Aerial Vehicle (UAV). Themethod 1400 includes causing the UAV to fly about the coverage area atone or more elevations (step 1402); causing the UAV to take measurementsof wireless performance during flight about the coverage area (step1404); and utilizing the measurements to derive a 3D coverage map of thecoverage area (step 1406). The method 1400 can further includeperforming one or more remedial actions to address any poor coverageareas based on the 3D coverage map (step 1408). The one or more remedialactions can include adding additional antennas to the cell site,adjusting antenna patterns of existing antennas, and adding new celltowers in the coverage area.

The method 1400 can further include providing the 3D coverage map to anAir Traffic Control system for UAVs, wherein the Air Traffic Controlsystem determines no-fly zones for any poor coverage areas based on the3D coverage map (step 1410). The UAV can include a spectrum analyzerwhich measures the wireless performance and a location device whichcorrelates a location for each measurement. The one or more elevationscan be 100′ or more. The UAV can fly a circular pattern about a celltower associated with the cell site. The UAV can adjust flight based onthe measurements of wireless performance. The UAV can fly a zigzagpattern from a cell tower associated with the cell site to an adjacentcell site.

§ 18.0 Anti-drone Flight Protection

As described herein, the UAV air traffic control system 300 can be usedto control various aspects of flight of the UAVs 50. With theproliferation of the UAVs 50 in various applications such as dronedelivery, surveillance, hobby, and the like, there is a critical need toenforce so-called no-fly zones and geofences. As described herein, ano-fly zone is an area where UAVs 50 are prohibited to fly such as forregulations (airports, national security, etc.) or for private propertyreasons (telecommunication sites, etc.). A geofence is a virtualizedfence which prevents UAVs 50 from accessing a location. Both the no-flyzone and the geo-fence are interrelated concepts, and each can bedefined by coordinates such as latitude, longitude, and altitude. Thatis, a no-fly zone or geofence can be any three-dimensional space definedby associated coordinates.

Referring to FIG. 28, in an exemplary embodiment, a flowchartillustrates an anti-UAV flight protection method 1500. In variousexemplary embodiment, the present disclosure includes defining no-flyzones as geofences, providing the defined geofences to associated UAVs50, and preventing flight in the defined no-fly zones or geofences ofthe UAVs 50. The method 1500 includes receiving one or more no-fly zoneseach defined as geofences with associated coordinates (step 1502);preventing one or more UAVs from entering the one or more no-fly zonesby one or more of: transmitting the geofences to the one or more UAVs,transmitting avoidance commands to the one or more UAVs from anavoidance device located at a no-fly zone, and disrupting radiocommunication to the one or more UAVs from the avoidance device (step1504). The method 1500 can further include periodically receivingupdates or additions to the one or more no-fly zones (step 1506).

Each geofence is defined by the associated coordinates comprising a setof latitude, longitude, and altitude values. That is, the geofence canbe a geometric shape (of any variation or size) which defines a no-flyzone. Note, the no-fly zone can be complete (no UAVs 50 at any altitude)as well as altitude specific (UAVs 50 at some altitudes, but notothers). Again, the no-fly zones can be for any reason telecommunicationcompounds/cell sites, data centers, historical monuments/locations,privacy centers, etc. The transmitting the geofences to the one or moreUAVs can be performed by the UAV air traffic control system 300 for UAVsusing one or more wireless networks to communicate to the one or moreUAVs, as described herein.

Additionally, the transmitting the geofences to the one or more UAVs canbe performed by the UAV air traffic control system 300 using one or morewireless networks to communicate to the one or more UAVs. The UAV airtraffic control system 300 can be configured to monitor one or more of alocation and a flight plan of the one or more UAVs and to transmitproximate geofences to the one or more UAVs based on the one or more ofthe location and the flight plan.

Referring to FIG. 29, in an exemplary embodiment, a block diagramillustrates an avoidance device 1550 placed in a location to enforce ano-fly zone or geofence of UAVs 50. The avoidance device 1550 includes aprocessor 1552, wireless interfaces 1554, a data store 1556, and memory1558. The avoidance device 1550 can include other functional componentswhich are omitted for simplicity (e.g., power, housing, a wired networkinterface, etc.). The avoidance device 1550 is a location specificdevice, placed at a no-fly zone. The objective of the avoidance device1550 is to prevent UAVs 50 from flying in a no-fly zone defined by ageofence enforced by the avoidance device 1550. The avoidance device1550 can be used with or without the UAV air traffic control system 300.

For example, with the push for drone delivery, the avoidance device 1550is critical to pair with the avoidance sensors already attached to UAVs50 as a safety measure. The avoidance device 1550 can be accessedlocally or remotely via a network (such as the wireless networks) andprogrammed. This can include receiving the geo-fence coordinates,receiving commands to power up/power down the geofence, receivingcommands to change the geofence, etc. For example, the avoidance device1550 could power the geofence down to allow UAV 50 maintenance at thelocation.

The wireless interfaces 1554 can include LTE/cellular interfaces, Wi-Fiinterfaces, and UAV-compliant interfaces, i.e., the wireless interfaces1554 can support multiple different wireless protocols and RadioFrequencies. Using the LTE/cellular interfaces, Wi-Fi interfaces, etc.,the wireless interfaces 1554 can support remote communication with theavoidance device 1550.

For the wireless interfaces 1554 operating the UAV-compliant interfaces,the UAV-compliant interfaces are configured to i) communicate theavoidance commands to proximate UAVs over Radio Frequencies associatedwith the one or more UAVs and/or ii) disrupt radio communication to theone or more UAVs from the avoidance device.

The UAVs 50 operate on the RC frequency band, therefore, cellular calls,and data usage is not be disrupted if the avoidance device 1550 ispowered on and blocking UAVs 50. The avoidance device 1550 can operatewith a database in the data store 1556 with coordinate data(Lat/Long/Altitude data) for geofencing the UAVs or UAV RF blockingsolution to still allow calls/data. The UAV RF blocking can broadcast ata set power level based on the desired area for blocking.

The avoidance device 1550 includes a transmitter configured tocommunicate the avoidance commands to proximate UAVs over RadioFrequencies associated with the one or more UAVs. Herein, the avoidancedevice 1550 can be programmed with a plurality of avoidance commandsbased on a type of UAV 50 and the avoidance device 1550 is configured totransmit the plurality of avoidance command over the Radio Frequenciesassociated with the one or more UAVs 50. Also, the avoidance device 1550can include a transmitter configured to perform the disrupting overRadio Frequencies associated with the one or more UAVs, wherein theRadio Frequencies do not interfere with other wireless networks. Theavoidance device 1550 can be communicatively coupled to UAV air trafficcontrol system 300 using one or more wireless networks.

§ 19.0 Network Switchover and Emergency Instructions

Referring to FIG. 30, in an exemplary embodiment, a flowchartillustrates a UAV network switchover and emergency procedure method1600. The method 1600 can be implemented by the UAV 50 in conjunctionwith the ATC system 300 and the wireless networks 302, 304. The method1600 includes communicating to an Air Traffic Control (ATC) system via aprimary wireless network (step 1602); receiving and storing emergencyinstructions from the ATC system (step 1604); detecting communicationdisruption on the primary wireless network to the ATC system (step1606); responsive to the detecting, switching to a backup wirelessnetwork to reestablish communication to the ATC system (step 1608); and,responsive to failing to reestablish communication to the ATC system viathe backup wireless network, implementing the emergency instructions(step 1610).

Thus, the method 1600 enables the UAV 50 to maintain connectivity to theATC system 300 during an outage, catastrophe, etc. The ATC system 300 isconfigured to provide the emergency instructions from the ATC system 300for use in case of a network disturbance or outage. The UAV 50 isconfigured to store the emergency instructions. The emergencyinstructions can include an altitude to maintain and a flight plan tomaintain until communication is reestablished, nearby landing zones toproceed to, continuing to a destination as planned, immediate landing atone of a plurality of designated locations, flying lane information,hover in place, hover in place for a certain amount of time to regaincommunication, hover in place until a battery level is reached and thenland or proceed to another location, and the like. Of note, the ATCsystem 300 can periodically update the emergency instructions. Further,the ATC system 300 can provide multiple different emergency instructionsfor a local decision by the UAV 50. The objective of the method 1600 isto ensure the UAV 50 operates with communication to the ATC system 300and in the absence of communication to implement the emergencyinstructions.

The method 1600 can further include, during the emergency instructions,reestablishing communication to the ATC system via one of the primarywireless network and the backup wireless network; and receivinginstructions from the ATC system. The primary wireless network caninclude a first wireless provider network and the backup wirelessnetwork can include a second wireless provider network. The firstwireless provider network and the second wireless provider network caninclude a cellular network, such as LTE. The UAV 50 can include awireless interface configured to communicate to each of the firstwireless provider network and the second wireless provider network. Thecommunicating to the ATC system can include providing flight informationto the ATC system; and receiving instructions and updates from the ATCsystem for real-time control. The flight information can include weatherand obstacle reporting, speed, altitude, location, and direction, andthe instructions and updates can relate to separation assurance, trafficmanagement, landing, and flight plan.

In another exemplary embodiment, the UAV 50 is configured for networkswitchover to communicate with an Air Traffic Control (ATC) system. TheUAV 50 includes one or more rotors disposed to a body and configured forflight; wireless interfaces including hardware and antennas adapted tocommunicate with a primary wireless network and a backup wirelessnetwork of a plurality of wireless networks; a processor coupled to thewireless interfaces and the one or more rotors; and memory storinginstructions that, when executed, cause the processor to: communicate toATC system via the primary wireless network; receive and store emergencyinstructions from the ATC system; detect communication disruption on theprimary wireless network to the ATC system; responsive to detection ofthe communication disruption, switch to the backup wireless network toreestablish communication to the ATC system; and, responsive to failureto reestablish communication to the ATC system via the backup wirelessnetwork, implement the emergency instructions.

Although the present disclosure has been illustrated and describedherein with reference to preferred embodiments and specific examplesthereof, it will be readily apparent to those of ordinary skill in theart that other embodiments and examples may perform similar functionsand/or achieve like results. All such equivalent embodiments andexamples are within the spirit and scope of the present disclosure, arecontemplated thereby, and are intended to be covered by the followingclaims.

What is claimed is:
 1. A method configured for implementation by anUnmanned Aerial Vehicle (UAV), the method comprising: communicating withan Air Traffic Control (ATC) system via a primary wireless network, theprimary wireless network being associated with a first cell tower;receiving emergency instructions from the ATC system; storing theemergency instructions in memory, the emergency instructions configuredto be implemented during an emergency situation; detecting whencommunication with the ATC system via the primary wireless network isdisrupted; responsive to detecting when the communication with the ATCsystem via the primary wireless network is disrupted, implementing anetwork switchover procedure to attempt to reestablish communication tothe ATC system via a backup wireless network, the backup wirelessnetwork associated with a second cell tower; and responsive to a failedattempt to reestablish communication to the ATC system via the backupwireless network, implementing the emergency instructions.
 2. The methodof claim 1, further comprising: during the process of implementing theemergency instructions, attempting to reestablish communication to theATC system via one of the primary wireless network and the backupwireless network; and receiving instructions from the ATC system.
 3. Themethod of claim 1, wherein the communication is disrupted due to one ofa network disturbance and an outage.
 4. The method of claim 1, whereinthe emergency instructions comprise an altitude to maintain and a flightplan to maintain until communication is reestablished.
 5. The method ofclaim 1, wherein the emergency instructions comprise nearby landingzones to proceed to.
 6. The method of claim 1, wherein the emergencyinstructions comprise continuing to a destination as planned.
 7. Themethod of claim 1, wherein the emergency instructions comprise immediatelanding at one of a plurality of designated locations.
 8. The method ofclaim 1, wherein the emergency instructions comprise flying laneinformation.
 9. The method of claim 1, wherein the primary wirelessnetwork comprises a first wireless provider network and the backupwireless network comprises a second wireless provider network.
 10. Themethod of claim 9, wherein the first wireless provider network and thesecond wireless provider network comprise cellular networks.
 11. Themethod of claim 9, wherein the UAV comprises a wireless interfaceconfigured to communicate with the first wireless provider network viathe first cell tower and with the second wireless provider network viathe second cell tower.
 12. The method of claim 1, wherein thecommunicating with the ATC system comprises: providing flightinformation to the ATC system; and receiving instructions and updatesfrom the ATC system for real-time control.
 13. The method of claim 12,wherein the flight information comprises weather and obstacle reporting,speed, altitude, location, and direction, and wherein the instructionsand updates relate to separation assurance, traffic management, landing,and flight plan.
 14. An Unmanned Aerial Vehicle (UAV) configured fornetwork switchover to communicate with an Air Traffic Control (ATC)system, the UAV comprising: one or more rotors disposed to a body andconfigured for flight; wireless interfaces including hardware andantennas configured to communicate with a primary wireless network and abackup wireless network of a plurality of wireless networks, each of theplurality of wireless network being associated with communicationequipment different from the communication equipment associated with theother wireless networks; a processor coupled to the wireless interfacesand the one or more rotors; and memory configured to store networkswitchover instructions that, when executed, cause the processor to:communicate with the ATC system via the primary wireless network;receive emergency instructions from the ATC system, the emergencyinstructions configured to be implemented during an emergency situation;store the emergency instructions in the memory for use during theemergency situation; detect a communication disruption with the ATCsystem via the primary wireless network; responsive to detection of thecommunication disruption, implement a network switchover procedure toattempt to reestablish communication to the ATC system via the backupwireless network; and responsive to a failure to reestablishcommunication to the ATC system via the backup wireless network,implement the emergency instructions.
 15. The UAV of claim 14, whereinthe primary wireless network comprises a first wireless provider networkand the backup wireless network comprises a second wireless providernetwork.
 16. The UAV of claim 15, wherein the first wireless providernetwork and the second wireless provider network comprise cellularnetworks.
 17. The UAV of claim 14, wherein, to communicate with the ATCsystem, the wireless interfaces are configured to: provide flightinformation to the ATC system; and receive flight instructions andupdates from the ATC system for real-time control.
 18. The UAV of claim17, wherein the flight information comprises weather and obstaclereporting, speed, altitude, location, and direction, and wherein theflight instructions and updates relate to separation assurance, trafficmanagement, landing, and flight plan.
 19. The UAV of claim 14, whereinthe ATC system is configured to monitor or control the flights ofmultiple UAVs.
 20. The UAV of claim 14, wherein the network switchoverinstructions, when executed, cause the processor to implement theemergency instructions in response to failed attempts to reestablishcommunication to the ATC system via the primary wireless network and thebackup wireless network.